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ABSTRACT 

Project Upswing was a two-year tutoring experiment 
directed by universities in Denver, Oxford (Mississippi) , St. Louis, 
and San Francisco and involving first graders identified by their 
teachers at the beginning of the school year as capable of normal 
achievement but having learning difficulties. Half of the students 
served as a control group and half were tutored twice a week, one 
hour each session, by adult volunteers. The project was evaluated for 
impact of tutoring on children's development of reading skills, 
visual-motor integration skills, and self-esteem and for 
effectiveness of tutor training. Analysis indicated that tutoring was 
effective in helping students improve their rates of progress in 
reading and their self-esteem b.ut that tutoring had no significant 
effect on visual-motor integration skill. As a byproduct of the 
evaluation, the data suggested that grade retention had negative 
effects. The mean reading score at the end of the year for both 
retained and promoted children was in the averaje range. But at the 
end of the second year, the reading score for those children who 
repeated first grade dropped significantly into the low-average 
range; the promoted children maintained their previous level. (TO) 
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SUMT-IARY 



Project Upswing was a two-year tutoring experiment conducted under 
the auspices of the Department of Health, Education, and Welfare, U.S» Office 
of Kducatlon, Bureau of Educational Personnel Development, There were Upswing 
projects directed by t.rlversltles in four cities: Denver; Oxford, Mississippi; 
St» Louis; and San Francisco, The children Involved were first graders 
Identified by their teachers at the beginning of the school year as capable 
of normal achievement but having learning difficulties. Half of the children 
were tutored and half were taken as a control group. 

The tutors were volunteers, primarily adult women. College students 
also served as tutors, especially In the small community of Oxford, Mississippi, 
where the nonstudent population Is small. In the first year of the project, 
half of the tutors received training, most of It before tutoring began; half 
had only a brief orientation. In the second year, all tutors received train- 
ing, much of It during the tutoring period. 

The children were tutored twice a week, one hour each session. Tutors 
worked out their own Instructional approaches with suggestions from project 
staff and teachers or with more extensive help as requested. Programmed 
materials were made available by the project but were not heavily used. 

The project was evaluated for impact of tutoring on children's develop- 
ment of reading skills, visual-motor Integration skills, and self-esteem. The 
evaluation was also concerned with whether training Increased tutor effective- 
ness and with the preferablllty of different training approaches, 
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The children's skills lu the criterion areas were measured before and 
after tutoring with a battery of standardized Instruments (an experimental 
self-esteem measure was also administered) • Basic experiences also were 
measured, by the Test of Basic Experiences, as a proxy for family background. 
The pre- and post-tutoring test results for tutored and control group children 
were compared using multiple regression and analysis of covarlance. The latter 
was used to contro- for Initial skill level • 

A dlffereut group of children was Involved each year. Those tutored 
in the first year were tested at the end of second grade to determine effects 
of tutoring over time. 

The analysis Indicated that tutoring was effective In helping children 
Improve their rates of progress in reading, and their self-esteem. There was 
no significant effect on visual-motor integration skill. 

A project Impact beyond the Influence of tutoring was observed. In 
the first year, tutored children made significantly greater progress in read- 
ing (as measured by the Wide Range Achievement Test). In the second year, 
both tutored and untutored made significant gains in test-observed reading and 
self-esteem. Enlargement of basic experiences also occurred in both groups. 
The progress of the control ^roup in the second year appeared to be attributable 
to the Influence of the project on teachers. 

The data suggested that it does not matter so much how one goes about 
involving or training teachers or tutors. It does seem to matter that the 
sense of project entity be well-defined, that there be clear leadership; that 
involvement be reinforced periodically; and that the participants know that 
someone (preferably someone whom they see as authoritative) is paying attention 
to their efforts and the results of their efforts. This also applies to the 
children. 

Trained tutors were no more effective with their pupils than untrained. 
However, tutors felt a need for training and teachers considered trained tutors 
more effective. School principals also generally believed tutors should receive 
training. The inservice approach was preferred. 

Despite the value placed on training, many tutors did not attend regu- 
larly. It appeared that training might be valued more in theory than in practice 

ii 
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because training traditionally has been accepted as a good thing. It also 
appeared that training is valued more highly when little or none is available. 

The follow-up data were somewhat ambiguous because of the nature of 
attrition in the follow-up groups. However, the children generally maintained 
their reading standard scores established at the end of the year of Upswing. 
Thus it appears that the effects of Upswing tutoring probably are durable. 

Finally! there were two major findings that came as a byproduct of 
the Upswing evaluation v5r. rt. It: was difficult to determine the reasons for 
retention of a substantial proportion of children involved in the first year 
of Upswing; and the dr.ta s'lggested retention had negative effects. The mean 
reading score from the test given at the end of Upswing was in the average 
range for retained children as for those who were not retained. The group 
kept in first grade lost ground during the follow-up year. Their mean read- 
ing standard score at th*^. end of the follow-up year dropped signif icantlj* into 
the low-average range; the other children maintained their previous level. 
The Upswing data also showed that remedial reading generally was not effective 
in bringing up the reading scores of follow-up children. When the project was 
present J the children who had remedial reading did show a substantial mean 
increase in reading score; children who had tutors instead of remedial reading 
showed almo&'t as great a mean increase. These results pose some questions 
about the comparative value of remedial reading, considering the high cost. 

In the final analysis, Project Upswing is found to be a cost-effective 
means of serving the large number of children with early learning problems . 
The project seems to be effective in both urban and rural settings. It could 
be a means of reaching the vast numbers of children with learning problems 
throughout the nation who now receive no help. 
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I. STATEMENT OF li-.t RESEARCH PROBLEM 



A teacher working alone with a class of typical size (usually 
25-30 students) does well to give 10 minutes a week of individual help 
in a subject area to each child. Very nearly everyone in education 
recognizes the value of individualized instruction, particularly for 
children who have learning problems; but tight school budgets rarely 
make this help possible* 

Individual instructional needs of certain kinds can be satisfied 
by programmed materials, which provide feedback important for learning. 
However, there is a strong argument that needs for personal interaction 
are as important, if not more important than instructional needs. Most 
all teachers can point out children in their clafses whose need for 
positive reinforcement from an adult is so great that it impedes the 
children's academic progress. 

Use of volunteers in the schools is a way of meeting special 
needs of individual children in a personal way without taxing school 
budgets. The question is, what can volunteers reasonably be expected 
to do? Traditionally, both voluntec-rs and paid aides have not been 
heavily involved in instruction. Most commonly, they relieve teachers 
of clerical and housekeeping chores, and supervlb*-: children in follow-up 
work or play, so that the teachers have more time for instruction. Tutor- 
ing by volunteers who do not necesf>arily have teaching credentials is a 
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relatively recent trend. If volunteers are effective in this role, a 
great ruiuy more children could receive individualized instruction, 

PREVIOUS RESEARCH FINDINGS 

« 

A review of the literature Indicates that most tutoring projects 
that have been evaluated Involved high school and upper elementary students 
tutoring younger students. Often the student tutors themselves have had 
problems In the subject of tutoring; and the experience Is Intended to 
give them a boost as well as their pupils. 

Reading first, and then mathematics, seem to be the favorite 
subject areas for tutoring. Most reports describe projects with quite narrowly 
focused objectives— for example, children will be able to produce the sounds 
associated with the letters of the alphabet and name the letters, or children 
will Increase their sight vocabularies by x number of words by the end of 
the tutoring period. The tutoring periods most commonly were brief - 4 to 
10 weeks . 

A number of studies have considered the effects of tutoring on 
the self concepts of tutors, tutees, or both. More positive self-concept 
has been regarded as a potential by-product of the tutoring experience. 
No study was found of a project that defined and applied direct methods 
of helping children Improve their self-concepts. 

Although ORl's review of previous research was not exhaustive. It 
indicated that tutoring projects oi. all kinds generally have been found 
successful In Improving their target academic skills, sometimes success- 
ful In Improving motivation to achieve, and rarely successful In Improving 
self-concept. The literature Is not without contradictions, but these 

trends are clear. 

Generally the reported projects Involved some kind of pre- and 
post-tutoring test (or tests) and a control group of children. The projects 
tended to be small, rarely Involving more than 50 tutored children. No 
previous project was found to have the diverse settings and geographic 
dispersal of Upswing, which was conducted In four cities over the United 
States. 
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While it is easy to fault other's research methodology, it should 
be noted that in many cases evaluation reports leave important questions 
unansv;ered and indicate less than rigorous procedures. The Upswing experience 
makes it easy to sympathize with problems in ensuring "clean" data. However, 
some caution should be used in accepting the reported success in many cases, 
especially when very small numbers of children were involved. 

It is worth noting that several studies in which tutors were required 
to use a programmed instructional procedure suggest that this may be a more 
fruitful approach for tightly-defined, strictly acadeT\*ic objectives than 
leaving it up to the tutor to plan instruction.^ There are some problems 
with a strict programmed approach, however. One of particular importance 
is that it requires selection of children on a rather narrow set of char- 
acteristics. A second major problem related to the first, is that it is 
easy to overlook individual differences; adherence to the program may take 
precedence over the child, especially when the tutor is relatively unsophis- 
ticated. Third, for a long-term project, strict adherence to a program can 
bore both child and tutor. A programmed approach may be essential when tutors 
are young, and may be both more comfortable and more effective for some older 
tutors ir certain kinds of projects. Upswing tutors had access to programned 
materials and still preferred planning their own approaches, although they 
wanted guidance. 

OVERVIEW OF PROJECT UPSWING AND ITS SFiNIFICANCE 

Project Upswing was a two-year pilot program studying the effects 
of tutoring by adult volunteers on first-grade children who demonstrated 
nonspecific learning difficulties that were expected to influence their 
reading achievement. The idea was to intervene before a failure pattern 
could be established. Preserving or boosting children's self-esteem was an 
important consideration. Approximately 800 children received Upswing tutoring. 
The children were quite heterogeneous in causes and manifestations of learning 
difficulties. 



^ Harris, 1967; Ellison et at. , 1969; American Institutes for Research in 
the Behavioral Sciences, 1971. See Appendix A for complete references. 
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Essentially, the evaluation of Upswing involved comparison of tutored 
children with a control group for changes in reading skill, visual-motor 
integration, and self-esteem. The project design called for groups drawn 
randomly from a pool of candidates for tutoring selected by teachers* The 
groups were checked for comparable initial reading and visual-motor skills, 
and comparable IQ, through analysis of a preliminary test battery* A follow-up 
analysis was done for the children tutored in the first year of Upswing to see 
if gains would hold over a year without tutoring* 

A special feature of the Upswing evaluation was Its focus on training 
issues* It addressed the questions of whether training is necessary, if so, 
why, and what kinds of training are preferable* The evaluation also looked, 
with particular care, into the relationship between reading difficulty and 
self-esteem, and the effect of the one-to-one relationship on self-esteem* 
Finally, the evaluation included analysis of operational data from the two- 
year project development effort to determine whether different management 
approaches seem to influence tutors* effectiveness and satisfaction* 
The rationale for Project Upswing was as follows: 
1* If an inexpensive approach can be developed to identify 
:,hildren with nonspecific learning problems in the 
first grade, and if an inexpensive general treatment 
can be applied effectively to that group, then large 
numbers of children can be helped through the crucial 
first year of school* This could substantially reduce 
the number of failure-oriented children who require 
expensive remedial treatment, which, when given, often 
is to no avail* Such a program could be applied in 
remote communities where professional help is scarce 
or nonexistent* 
2. It is clear that professional diagnosis and treatment 
cannot be employed in any ultra-low-cost programs* 
As an alternative. Upswing used teacher screening 
as a rough form of diagnosis* Teachers generally 
have definite opinions as to which children in their 
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classes need special help With minimal training in 
the use of diagnostic chicklists, teachers can identify 
a hetergeneous populatL^n of children with learning 
problems. Although tba specific causes of the problems 
may not be known, the general problems may be diagnosed. 
The best treatment ferhaps would be based on a full 
understanding of a child *s problem, but this is pro- 
hibitively expens'^.ve in most cases. 

3. As an altemativf to specific professional treatment. 
Upswing used a very general affective approach applied 
by volunteers. The treatment was different for each 
child, because each volunteer introduced his or her 
personality as a key feature of treatment. The plan 
was heavily dependent on the volunteer's ability to 
form a relationship with the child and perhaps boost 
self-esteem. 

4. The actual cost of such a program if put into practice 
on a moderate scale with a salaried management could 
be about $80 per child per year. The issue of whether 
the cost of such a program can be justified revolves 
around the following: 

a. Can such a program help a significant number 

of children achieve at least at a passing level? 

b. Can such a program help children increase their 
reading ability? 

c. Can such a program help children raise low self- 
esteem? 

d. Can such a program reduce needs for remediation? 

The task of evaluating Project Upswing was to determine if the 
effectiveness of the program in any or all of these areas was sufficient 
to justify its cost. 
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II • DESCRIPTION OF PROJECT UPSWING 



Upswing children were tutored Individually twice a week — In school, 
but outside the classroom* Tutoring sessions lasted 45 minutes to an hour. 
The tutor was supposed to concentrate on establishing a warm, relaxed rela- 
tionship with the child to help him 

• Develop and maintain a positive attitude toward 
academic tasks 

t Acquire the reading skills expected at his age 

• Develop his self-esteem as a person and, In 
particular, as a learner* 

Tutors received training for their work from a university school of 
education staff* A broad-brush approach to training was used* It covered 
a variety of topics from child development, to description of specific types 
of learning problems, to techniques of teaching reading and writing, to 
behavior management and positive reinforcement* The Importance of fostering 
ego strength was a constant theme* 

In the first year of Upswing, half of the tutors received only a 
brief orientation; this group provided a control for checking the need for 
training* In the second year, all tutors were offered training of some 
kind. 

Teachers received a very brief orientation to project objectives 
and procedures in the first year, which they did not find adequate. In the 
second year they received a more extensive orientation* In addition. 
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follow-up was conducted throughout the tutoring period, generally in the 
form of group sessions, to ensure that teachers* questions and problems 
concerning the project were resolved and to give project staff an oppor- 
tunity to receive teachers* suggestions. In some cases, teachers received 
Instruction In techniques of diagnosing and helping to correct learning 
difficulties and In the philosophy and practice of positive response to 
children's behavior* 

A new group of children was involved each year* The effects of 
tutoring were evaluated at the end of each year by comparative analysis 
of pre- and post-tutoring test results for tutored children and a control 
group. Attitudes and opinions of tutors, teachers, principals and university 
staff were weighed against the test results. The original group of children 
was followed through testing and through evaluation by their second-year 
teachers, to see if the effects of one jear of tutoring would endure. 

INSTITUTIONS INVOLVED IN UPSWING 

Upswing was conceived by Volunteers in Education, a unit of the 
U.S. Office of Education (USOE) , Department of Health, Education and Welfare. 
USOE gave grants to university departments of education in five cities to 
plan and conduct the project. They were: University of Denver, University 
of Missouri, St. Louis; California State University, San Francisco; Uni- 
versity of Mississippi at Oxford; and University of Cincinnati. The last 
university was unable to meet the project requirements and was dropped from 
the study. Although university staff had major responsibility for the project, 
in all cases it was a cooperative effort of that group, the local school 
system, and, where one existed, the local school volunteer organization. An 
independent evaluation of Upswing was performed by Operations Research, Inc., 
(ORI) , Silver Spring, Maryland, under a contract with USOE^s Bureau of Educa- 
tion for the Handicapped, Division of Research. 

DESCRIPTION OF BASIC PROJECT ACTIVITIES 

Volunteer Recruitment 

Volunteers were recruited by the university project staffs, in some 
cases with the help of the local school volunteer organizations. Newspapers, 
television and radio announcements were used, project directors spoke before 
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community groups, and in some cases university students were sought through 
classroom announcements and bulletins* Recruitment campaigns took place in 
the summer before each school year, although efforts to get enough volunteers 
often continued into the fall when, for example, elementary school principals 
were asked to refer potential volunteers to Project Upswing. 

Selection of Elementary Schools 

The project directors worked with school system administrators and 
principals to select schools for the project* The choices were made to 
obtain a geographic and socioeconomic mix of schools in each city, within 
the limits of principals' willingness to participate* Oxford, Mississippi, 
has only two schools — one for the city and one for the county, the latter 
drawing children primarily from rural homes. Both schools participated. 
Nineteen Denver schools were involved in the first year of Upswing, eight 
St. Louis schools, and 10 in San Francisco. In the second year, five to 
six schools were involved in all cities except Oxford. The number was 
reduced to make the project management easier. Throughout the project, 
more schools wanted Upswing than could be included. 

Selection of Teachers 

Principals asked first-grade teachers to participate in Project 
Upswing. Teachers could refuse, but few did. 

Selection of Children 

The first-grade teachers in participating schools were asked to 
identify children for the project. They did so based on observation of 
their students during the first month of school. In Upswing's first year, 
child identification was left entirely to the teacher, except that they 
were asked to make decisions based on the following broad criteria: 

• The children should appear to have potential for 
nomat funationingi i.e., they should not be 
severely handicapped intellectually or physically. 

• The children should show signs of being unable to 
function normally in the classroom setting because 
of some difficulty, such as a perceptual problem. 
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delayed establishment of left-right dominance, 
relative lack of basic experiences, etc* 

In the second year of Upswing, teachers were instructed in techniques 
of observing children in an orientation/training meeting held shortly after 
school opened. Teachers also were given a readiness inventory to use as a 
check on their selections (the Cegelka Academic Readiness Evaluation) . 

It should be noted that teachers did not fill out the readiness 
inventory for of their pupils. They first screened subjectively and 
then completed the inventory for those children whom they considered to have 
the greatest number of problems or (within the limits of the Upswing criteria) 
the most serious problems. 

The Upswing project directors divided the children referred by teachers 
into two groups, one that would receive tutoring and one that would not. 
This was supposed to be done on a random basis, within the following two con- 
straints. No teacher could have more than six students involved in Upswing, 
to ensure that the project would not be a burden. Further, insofar as pos- 
sible, each teacher had an equal number of tutored and control group children, 
to hold constant the effects of classroom experiences. The analysis of test 
data indicates grouping was not always randomly done. It appears that sometimes 
project staff responded to pleas from teachers to give tutors to the children 
who had the worst problems, or that project staff did so on their own after 
examining the readiness inventories. 

All children identified' for the project were tested at the beginning 
of the school year. The test battery included:^ 

• Wide Range Achievement Test (WRAT) , Level I, 
Reading Subtest — to measure change in reading 
skills component of school performance 



In the first year of the project testing was done rather late. and went on 
after tutoring began. Most was completed in November and December 1971; 
some, however, was not done until January 1972. In the second year, all 
testing was done in October 1972. 
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• Beery-Buktenica Developmental Test of Visual- 
Motor Integration — to measure change in psycho- 
motor behavior defined as level of visual- 
motor integration skill 

• Test of Basic Experiences (TOBE) , Level L, 
General Concepts Subtest — to measure change in 
grasp of fundamental concepts relevant to 
school performance — such concepts as size, loca- 
tion, congruity, distance, etc. 

• The Funny Faces Game, an inventory of self- 
perceptions in relationships and situations 
encountered by children starting school. 

An IQ test, a behavior rating scale, and the Metropolitan Achievement Test, 
reading subsection, were used in the first year, but dropped in favor of the 
TOBE, and the self-esteem inventory. 

The pretest battery was readministered at the end of each school 
year. Post-testing was done at the end of April or in May. 

Volunteer Training 

Volunteers were introduced to the project in meetings held each year 
before tutoring began. The purposes of these meetings were: 

• To acquaint participants with the goals of the 
project and its organization 

• To give them some information about child develop- 
ment and the characteristics of children with 
learning difficulties 

• To introduce them to procedures they would be 
expected to follow in the schools 

• To describe the kinds of materials available 
for use in tutoring. 
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Meetings were held during the tutoring period to provide further 
training In specific Instructional techniques and to work on problems that 
arose In the tutoring situation. 

In general, the first yearns training was more formal and more 
heavily preservlce. Considerably greater emphasis was placed on continuing 
support to volunteers during tutoring In the second year* For the second 
year, the project director and staff In each city developed the training 
program they felt would best meet the needs of their volunteers. 

As noted previously, half of the volunteers In the first year 
received orientation only. Generally the project directors followed 
volunteer preference In making group assignments, within the constraint 
that the groups had to be approximately equal In number. This was not a 
good approach methodologically, since It admits the possibility of group 
differences In motivation, self-confidence, or both. However, there was 
evidence that arbitrary assignments would cause people to quit, or at least 
promote some dissatisfaction, causing a different type of bias. In terms 
of sex, level of education. Income, and relevant training and experience, 
the groups were reasonably well matched. 

Teacher Orientation/Training 

One or more meetings for teachers was held before tutoring began, 
to acquaint them with the goals and organization of Upswing and to discuss 
selection of children as described above. Teachers had only a brief orien- 
tation in the first year of Upswing; in the second year teacher woikshops 
were held In two cities throughout the tutoring period. In some cases. 
Upswing provided teachers with Information on instructional techniques in 
addition to soliciting their ideas for tutors. As was true for volunteers, 
a great deal more emphasis was placed on continuing interaction with teachers 
in the second year of Upswing. 
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Tutoring 

Tir^^e and Place. Tutors and children met twice a week for 45 minutes 
to an hour per session. Tutoring was done at school, durirg school hours ^ 
but outside the classroom in auditoriums, hallways, multipurpose rooms, 
cafeterias, or wherever space could be found. 

Lesson Plans and Content. Tutors prepared their own plans. They 
were asked to set aside one hour per week for this purpose. In some cases 
they were required to use lesson plan forms and turn them in to Upswing 
staff for review. That requirement generated some dissatisfaction among 
the tutors, but some projects found it helpful in "quality control" and in 
providing more relevant assistance to tutors^ 

Although tutoring was supposed to focus on reading, self-esteem, 
and visual-motor coordination, volunteers found themselves responding to 
a variety of needs of their individual pupils. The feeling was that it is 
difficult and inappropriate to isolate skills when working with children so 
young. 

Tutoring Materials . Some materials were provided by the project — 
e.g., a commercial language development kit, a progt'ammed reading system, 
books, games and puzzles, etc. Some schools provided paper and art supplies. 
Volunteers at times arranged with teachers to use classroom materials. They 
also bought, borrowed, and made materials on their own. They favored using 
a variety of simple materials, and many put aside the project-supplied 
language and reading kits because they felt their pupils wanted a change 
or that those materials were complicated to use. 

Special Activities . Some tutors got permission to take children 
out of school on special trips, took them out on weekends, visited in their 
homes, or invited the children to visit them at home. Such extras were done 
on the volunteers* initiative. The project did not suggest or assist in 
activities outside of school, but in a good number of cases tutor and child 
developed a special kind of friendship. 

Teacher-Tutor Interaction . The degree of interaction between teachers 
and tutors was according to individual predispositions* Tutors called for 
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chelr pupils at the classroom and often talked briefly with teachers then. 
Conferences had to be held at lunch time, after school, or some other time 
when teachers were free. Telephone conferences were fairly common. In 
general, there was more tutor-teacher interaction during the second year. 
The increased interaction was fostered by project staff, after it was 
found in the first year that both tutors and teachers felt a need for more 
communication with each other. 

Conminioation Between Upawinci Staff and Partioipants , Upswing 
staft often served as liaisons between teachers and tutors, in addition 
to talking regularly with each individually and maintaining communication 
with principals. This was more true in the second /ear of the project, 
when a staff member visited each school at least once a week, offering 
tutors advice, assistance, anO reassurance as needed, and checking with 
teachers for problems or observations* 

CHARACTERISTICS OF TUTORS AND TEACHERS INVOLVED IN THE PROJECT 

The following data were taken from the "First Impressions" question- 
nalr'^s completed by tutors and teachers in the second year of Upswing. These 
groups were very similar from year to year; in fact, about 40% of the tutors 
and 72% of the teachers participated both years. The characteristics of 
children involved are described in Section IV, as a preface to analysis of 
tutoring impacts. 

Tutors 

Almost all of the Upswing tutors were women — either college students 
or homemakers not otherwise employed. The Oxford project supplied most of 
the college students (about 70% of Oxford tutors were in that occupational 
category); the St. Louis project also involved a significant number of students 
(about 40% of that city's tutors). 

The age distribution was skewed to the young side by the college 
student concentrations. Still, considerable variation in age existed. The 
range was under 21 to over 60 years, with most between 21 and 50. In short, 
people of all ages were attracted to Upswing. 

The tutors tended to be well-educated. About half attended college 
but had not completed undergraduate work. About 30% had completed bachelor's 
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or advanced degrees* Only two had not finished high school* About 45% of 
the tutors had previous direct relevant training in child development* From 
the distributions of response in each city, the 40% were not necessarily 
college students* 

The tutors also tended to have relevaxit experience* It was pre- 
viously noted that 40% worked In Upswing both years* Roughly 50% had exper- 
ience outside Upswing, as tutors, teacher aides, or teachers* These forms 
of experience were not cross tabulated, and some overlap can be assumed* 
However, it appears reasonable to estimate that 60%-70% of the tutors had 
relevant experience from some source* Forty-one percent had worked outside 
Upswing with children who had learning difficulties* 

Socially, Upswing drew the kind of tutors one might expect to draw 
for tutoring during school hours* The tutors generally appeared to be socio- 
economically advantaged, well-educated, and community-service oriented* They 
were people with time and energy, to actuate their motivation to contribute 
to child^'en's education* Unsuccessful efforts were made, particularly in the 
first year, to attract people with more varied background* Certainly different 
recruitment approaches would be required to accomplish this and probably it 
would be necessary to have greater flexibility about certain features of Up- 
swing organization (time commitment: required, tutoring hours, etc*)* 

The characteristics of Upswing tutors are important because of the 
evaluation findings about the Insignificance of training in helping children* 
It may be that this finding Is only valid for tutors like those currently 
in Up9\d.ng* It Is also clear that it would be more difficult to plan train- 
ing that would satisfy a majority of a less homogeneous group* Much different 
and more varied training approaches would be needed* The Individual support 
that was a feature of the second year of Upswing seems much more promising 
for tutors of divergent background* 

T eachers 

Since most of the teachers involved in Upswing's second year also 
were involved in the first, and background was not related to Upswing results, 
extensive data were not collected again *^ 

For details of the first-year population, see P. Plantec, et al^ li^iiiHT 
tlon O: Pro^ject J-ppwing: Intevim Reporiy ^ Technical Report No* 700. 
Silver Springy Maryland: Operations Research, Inc*, January 1972* 
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About 40% of the second year teachers said they had worked before their 
participation in Upswing, with children who had learning difficulties. 
About 60% said they had worked previously with a volunteer aide. The most 
striking response from teachers was that only 40% overall, and no more 
than 5A% in any city, said they had any training in child development other 
that that provided by Project Upswing. This is somewhat difficult to believe; 
but if it is true, then Upswing would appear possibly to have made a very 
important contribution to the backgrounds of teachers who attended training. 
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III. THE EVALUATION METHODOLOGY 



In broad terms, Upswing's fundamental hypothesis ^was that a child 
who experiences a one-to-one facilitating relationship with an adult tutor 
wl] 1 make better progress In overcoming learning difficulties than a child 
who does not experlerne such a relationship. A further hypothesis was that 
this kind of relationship In the first year of school can prevent failure 
and therefore is preferable to the common, but expensive, remedial approach. 
Beyond testing these hypotheses, the evaluation has tried to identify 
variables that have Impact on tutoring results — that is, the evaluation 
has tried to find out what, specifically, makes tutoring successful. 

PRELIMINARY METHODOLOGY 

Comparison Groups 

In the first year of the study there were three comparison groups 
for the evaluation of tutoring effects on children. Children were identified 
by teachers in each city as candidates for Upswing tutoring. These were all 
children who appeared to be capable of normal functioning, but in whom the 
teachers recognized signs of various minimal learning difficulties, particularly 
in development of reading skills. The children were divided randomly into 
three groups: one that would be assigned untrained tutors, one that would be 
assigned trained tutors, and one that would have no tutors. All of the children 
then were tested. Analysis of test results on IQ, initial reading level, and 
visual-motor integration, showed that the randomly drawn groups were very 
similar in these attributes. 

17 



ERIC 



30 



The analysis of change In test results from initial to final battery 
was a simple, two-way design involving comparisons of all tutored children 
versus untutored children and then of those tutored by trained volunteers 
versus those tutored by untrained volunteers. First, each city's project 
was treated separately. At this level of analysis, no meaningful differences 
between test results of comparison groups were found. After that was determined, 
the analysis was performed on aggregate data (children with trained tutors in 
all cities combined, etc.). Pooling the data for the four cities produced 
rtlfferent score distributions for the comparison gr aps, and pooling the 
city samples provided a larger sample base with a resulting increa-^e in 
statistical precision. The statistical procedures used, adjusted for prob- 
ability of error, etc., uncovered small but significant group differences. 

Variables 

The primary criterion or dependent variable of the evaluation was 
change in reading skill as measured by the WRAT. Change in visual-motor 
integration, as measured by the Beery-Buktenica Developmental Test, also 
was investigated. In addition, the evaluation considered change in other 
aspects of psychomotor control (distractibility and hyperkinesis) , change 
in oral language skills, and change in self-esteem as observed by the adults 
in the study. 

The primary independent variable was child's status vis-a-vis a 
tutor — i.e., whether the child had a tutor at all, and if so, whether that 
tutor was trained or untrained. The evaluation also looked at impact on 
tutored children of such tutor and teacher characteristics as age, level of 
education, experience working with children at the age level and with 
children who have learning problems, and (for tutors only) income level. 
Finally, it was hypothesized that a number of psychosocial variables would 
influence tutoring outcomes. These variables included, for example, the 
quality of relationships between tutor and child and between tutor and 
teacher, the teacher's feelings about working with volunteer aides in 
general, the tutor's confidence in his or her ability to help the child, 
the tutor's satisfaction with training or orientation and with Upswing in 
general, etc. 
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Data Sources 

The reading portion of the Wide Range Achievement Test and the 
Beery-Buktenlca Developmental Test of Visual-Motor Integration were adminis- 
tered at the beginning and end of tutoring to obtain measures of the dependent 
variables change in reading proficiency and change in visual-motor integra- 
tion skill. The Slossen 10 test was administered only at the beginning 
of tutoring, Quescionnaires completed by volunteer tutors and teachers 
were the data source for measures of all other study variables. 

Statistical Techniques 

Analysis of test score distributions was used to determine whether 
tutoring affected the children in the criterion areas of reading and visual- 
motor integration. The Student's T-test was used to determine the significance 
of differences between group mean test results. A significant level of 5% 
was selected as the criterion for accepting or rejectiiig all null hypotheses.^ 

Multiple linear regression analysis was used for deeper-level evalua- 
tion to identify variables that appeared to exert greatest influence on 
tutoring results. For this purpose, change in tested reading level was 
taken as the dependent variable, initial test scores, change scores, indi- 
cators of tutor and teacher background, and indicators of attitudes of par- 
ticipants and their relationships all were included in the regression as 
independent variables. In addition, tutors' and teachers' subjective assess- 
ments of certain kinds of changes in the children were included to see how 



^ The T-test is based on probability theory. Essentially the test estimates 
the likelihood that the means of two distributions differ by chance. When 
the differences between two means is found significant at the 5% level, that 
indicates the difference probably would occur 95 times out of every 100 times 
the experiment was repeated. If the experimenter selected a significance 
level of 10^, he would make a decision to accept a difference between his 
study groups as real if the T-test showed it would be likely to occur 90 
times out of every 100 times the experiment was repeated. The percentage 
represents the margin of error the experimenter is willing to tolerate. 
For statistical reasons too involved to explain here, the lower the signifi- 
cance level selected, the lower the chance that your "significant" findings 
are due to sampling error. 
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they would relate to test outcomes and to each other. These "psychosocial" 
Indicators were created using a modified Llkert procedure to scale response 
alternatives by how favorable to child progress they logically appeared to 
be. 

Multiple linear regression procedures produce an equation that 
predicts the value of a dependent variable (In the Upswing case, number of 
points change In reading test score) from the values of ordered Independent 
variables* The mathematical model assumes that the relationships between 
the dependent and Independent variables are 11m ^r• That Is, the model 
assumes that as the value of an Independent variable x Increases, the value 
of the dependent variable y will Increase, or will decrease. In a straight- 
line fashion for all observations. The model Is undermined to the extent 
that Increases (or decreases) In x sometimes are associated with Increases 
In y and sometimes with decreases In y. 

The regression output indicates the order of the Independent variables 
in terras of "goodness of fit." If there were a perfect relationship between 
the true and predicted values of y, the fit would be perfect — i.e., if the 
two sets of values were plotted, the connected points would be superimposed. 
Goodness of fit is expressed as a multiple correlation coefficient, "multiple 
r." Perfect fit yields a multiple r of 1.0, while no predictive power (no 
apparent linear relationship between x and y) yields a multiple r of 0. The 
square of tha multiple correlation coefficient expresses the amount of common 
variation between the independent and dependent variables. 

If the true values of y were predicted from the values of a single 
independent variable, there would be no naed to consider other variables; 
knowledge of that x would tell the value of y. In the absence of such a 
perfect association, the regression keeps trying; it adds in the information 
about y from successive independent variables, gradually perfecting the fit 
between the prediction and the true values of y. The procedure stops when 
a perfect fit is obtained (multiple r « 1.0) or, as is most often the case, 
when none of the remaining independent variables increases the value of r, 
i.e., helps to improve the fit between the true and predicted values of y. 

Multiple linear regression was used as a detective device in the 
analysis of Upswing data. It enabled us to identify which of the numerous 
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Independent variables hypothesized to have some bearing on development of 
reading skills appeared worthy of further consideration* It also provided 
insights about relationships between the dependent variables. Finally, it 
gave an idea of how much of the variation in reading progress we could hope 
to explain by the kinds of factors or conditions that had been considered. 

PRELIMINARY EVALUATION RESULTS^ 

Reading 

Analysis performed at the end of the first year of tutoring showed 
that tutoring did Increase chlldren*s rate of progress In development of 
reading skills as measured by the WRAT. The difference in point gain on 
the reading tesc was highly significant (a « O.OOl). In short » It Is 
highly unlikely that the test results turned out as they did due to chance 
error* 

In an absolute sense, gains were real but modest all around — an 
average of 7.5 age-adjusted standard score points for tutored children and 
an average of 4 points for untutored* Still, the changes represent catching 
up; if a child does not increase his rate of progress, but merely continues 
to develop at his original rate, his age-adjusted standard score will remain 
the same. (If a child stops progressing, his score will drop, since he is 
growing older, as of course it will if he regresses.) 

The analysis found the expected Inverse relationship between initial 
and final reading test score. Children who scored lower at the beginning 
tended to make higher scores it the end of the school year. In a test-re test 
situation involving large enough numbers of children, scores tend to converge 
toward the mean. However, in Upswing a ceiling may have been operative as 
well, because of the homogeneous IQ grouping and because of teacher or tutor 
expectancies. Children were selected for inclusion on the basic of average 
IQ» It appears that they may have been reaching their level of performance 
potential or the level perceived as appropriate by those working with them* 

^ A detailed presentation is available in Operations Research, Inc., Final 
Report on the Evaluation of Project Upswing^ s First Year^ Technical 
Report No. 731, December 1972. 
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Gains in reading proficiency were established based on an Individually- 
administered test. A group test of reading achievement also was used. It 
yielded erratic results Initially and contradictory results at the end of 
the year. In general, if any conclusion can be drawn from the group test 
data> they showed the children doing very poorly in reading. This occurred 
probably, at least in part, becatise the test Involved mark-sense coding and 
the children were first-graders with problems In visual-motor integration. 
Thus they were unable to keep from making stray marks on the test forms. This 
caused machine scoring errors, in addition, young children are unlikely to 
be self-motivated to achieve, as required by the large-group mode, in a formal 
test situation. Evidence indicates that children of that age often find a 
test setting irrelevant or Incomprehensible. 

It is possible that examiners prompted children in individual test- 
ing. Ha.;ever, all examiners had some training and experience in test adminis- 
tration, and the results in four cities were consistent. We conclude that 
the results of the individually-administered test are reasonably reliable and 
that it is a much better test, at le-as'; for young children. 

The differences in outccmos of. the two t:/pes of tests are Important 
beyond the scope of Upswing, since ?5chools usually are evaluated on the 
results of group-administered achievement te;:,ts. (Although such tests 
are norm-referenced, we do not b'^lieve that necessarily resolves the problem 
of unfair evaluation caused by measure»nfint of extraneous variance.) 

Relationship Between Tutor Trai ping and Chi j drftr 's Progress in Rea ding 

Tutor training status haci no meaningful effect on childret 's tested 
progress in reading or in any other area ur.ifsjr Btudy. This finding could 
reflect on the type of training given (primarily preservice orientation in 
a group lecture mode, with minimal follow-up during tutoring). Since train- 
ing did not influence the tutors^ success, it Is most interesting that trained 
and tmtrained alike generally thought training important and wanted to be 
trained. Teachers also thought trained volimt<iers generally were better and 
said they preferred to work with them. 
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visual -Motor Integration 

Both the tutored and untutored groups made virtually no progress in 
acquiring visual-motor integration skills. Both groups got about the same 
results on the final test in this aiea as on the initial test; i.e., both 
groups continued to score well below expectancy for their age level. 

Relationship Between Reading and Visual-Motor Integration Test Results 

There appears to have been some negative relationship between visual- 
motor skills and reading proficiency. A low negative correlation was obtained 
between tested reading and visual-motor integration levels, both at the begin- 
ning and end of the tutoring period (r = -0.13) for the two sets of initial 
test results and r » -0.12 for the two sets of final test results. 

Relationship Between IQ and Reading Test Results 

The Upswing data support the position that IQ, within the average 
range. Is not an important factor in progreee in development ot beginning 
reading skills (decoding). The correlation between change in tested reading 
level and IQ was -0.09. The correlation between initial reading score and 
10 was relatively high, 0.52, while the correlation of final reading score 
and IQ was lower, 0.40, as expected. There was limited variance in IQ 
among Upswing children since they were selected on potential for average 
functioning. Mo more than 5% scored outside the average range (approximately 
76-124) on the Slossen IQ measure. Variance in reading scores increased 
over the tutoring period, thus the lower correlation between IQ and final 
reading scores. 

Influence of the Independent Variables Selected for Study 

The regression analysis identified 35 independent variables that 
together "explained" about 35% of the change in reading level. The easiest 
way to interpret that finding is to say that, theoretically, if one knew the 
values of the 35 independent variables brought into the regression, one could 
predict the amount of change in a child's reading achievement score with 
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about 35% accuracy. This is quite a modest finding, but not insignificant 
in light of the inconclusive findings available on factors associated with 
development of reading skills. Much of the 65% unexplained variance probably 
is attributable to psycho-environmental and historical factors we were unable 
to measure* 

In common with most researchers, we found that characteristics of 
the child had most to do with the amount and direction of change in tested 
reading level. For example, change in child's level of self-esteem (as 
judged by volunteer) was found to be the second best predictor variable. 
Other comparatively important variables included change in child's ability 
to pay attention (distractibility) , child's response to tutoring activities, 
child's overall progress — all as assessed by the volunteer tutor; and change 
in child's oral language skills and ability to pay attention as assessed by 
the teacher. 

The best predictor, however, turned out to be an indicator based 
on the volunteer tutor's feelings about whether he or she was adequately 
prepared to use teaching methods and materials in tutoring. We do not know 
whether a tutor who feels adequately prepared is more effective or whether a 
tutor *s opinion about adequacy of preparation depends on the child's progress. 
Probably that is an individual matter. The correlation between reading 
progress and tutor feelings about being well prepared was slightly higher 
than 0.3. 

This is a reasonably high correlation for such data. Thus the find- 
ing would be significant if indeed it were clearly a matter of tutor prepara- 
tion versus child progress. However, the subjective measure of tutor- 
perceived adequacy is probably highly related to feedback the tutor obtained 
from his or her perception of the child's improvement. Thus this correlation 
probably is mediated by the tutor's ability to observe child progress. 

The relationships between test results and tutor and teacher assess- 
ments of progress in reading were intriguing overall. Both subjective assess- 
ments showed rather low correlations with change in test score. However, 
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the volunteers showed some ability to assess progress similar to that measured 
by the WRAT. It was interesting to note that teachers appear better able 
to perceive progress as measured by the group test of achievement t while 
volunteers are more sensitive to the type of progress measured on the 
individual test. This may say something about the perceptual set of the 
observer. 

FINAL EVALUATION METHODOLOGY 

The remainder of this section describes the rationales and proce- 
dures used in the evaluation of Project Upswing's second year, which Included 
first-year follow-up. The findings from this evaluation are reported in 
Section IV (tutoring effects on children and follow-up findings) and Section 
V (project management strategies and training approaches). 

The prellmlv.ary analysis Indicated it would be wise to separate the 
evaluation of tutoring effects on child progress from evaluation of project 
management strategy and training approach. The latter domain is important 
to a successful project in Itself, regardless of the difficulty of relating 
it to what happens to the children. A third domain of the final evaluation 
was the staying power of tutoring effects on cH-fldreu from the first year 
of Upswing over a year without tutoring. 

With regard to measurement of tutoring effects on children — both 
inunediate and over time — emphasis was put on improving the operational defi- 
nitions of the variables by upgrading the test battery and reducing field 
error noise. An experimental objective measure of self-esteem was added 
to measure this important variable on an ordinal scale. The Test of Basic 
Experiences (TOBE) was used to obtain a proxy measure of family background 
factors. (In the first year information about family background was sought 
through a questionnaire for parents, but the nonresponse rate was so high 
this approach was abandoned.) Data were collected on special educational 
sen^lces other than Upswing tutoring, since the evaluation team learned 
in site visits that it was not uncommon for both tutored and control children 
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to receive other forms of help. Reduction of the field error In testing 
was accomplished by requiring that all examiners be trained for Project 
Upswing and by rescorlng a sample of all tests. 

For the evaluation of training anv! project management, the opinions 
of tutors, teachers, principals and project staff were sought through ques-- 
tlonnalres and Informal Interviews* The evaluation team made site visits to 
observe training throughout the year, and vlsltad the schools In which Upswing 
tutors worked. In addition, a field data coordinator, hired In each city to 
assist In collection of evaluation data, was required to provide minutes of 
all training sessions. 

Comparison Groups 

Only two groups of children were Involved in the second year of 
Upswing — tutored and untutored. The child groups were to be drawn randomly 
by project staff from a pool of candidates identified by teachers, with the 
constraints that no teacher was to have more than six pupils involved and 
that half of each teacher's referrals should be assigned to the experimental 
group and half to the control group. All volunteers were offered training. 
This decision had to be made before the end of the first year of tutoring 
because of the timing of project grant decisions. Thus the first-yc^ar 
evaluation results were not available. The evaluation showed that trained 
tutors were no more effective than untrained and, comparatively, cost a good 
deal more. However, the evaluation also showed that the tutors wanted to 
receive training and that teachers preferred to v;ork with trained tutors. 

Variables and Data Sources for the Analysis of Effects on Children 

The primary criterion (dependent) variables established for the 
evaluation were: 

• Change in level of reading skill as measured 
by the WRAT 

• Change in level of visual-motor integration skill 
as measured by the Beery-Buktenica Developmental 
Test 

• Change in level of self-esteem demonstrated on the 
experimental "Funny Faces Game/' 
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As a check on the self-esteem measure, data on children's self-contldence 
In the one-to-one tutoring situation were sought from the volunteer tutors, 
and data on self-confidence demonstrated in the classroom b; both tutored and 
untutored children were elicited from teachers. (Copies of the data collec- 
tion instruments— "Student Prof iles"~used to obtain the tutor and teacher 
assessments of children are included in Appendix B.) 

The primary independent variable again was whether the child had a 
tutor. Other variables hypothesized as likely to influence change in the 
criterion areas are shown, with data sources indicated, in Table 1. 

Variables and Data Sources for the Analysis of Tutoring Effects Over Time 

The follow-up analysis considered whether one year of Upswing tutor- 
ing influenced children sufficiently to distinguish them in the subsequent 
school year from the Upswing children who did not receive tutoring. The 
primary criterion variable was level of tested reading skill after the year 
without Upswing, compared to tested reading skill immediately after the 
Upswing experience. Other potential differences that might be attributable 
to Upswing tutoring also were investigated, such as self-esteem, class stand- 
ing, and need for special services in the second year. Table 2 lists the 
follow-up variables, measures, and sources of data. 

As Table 2 shows, the primary independent variable was dichotomous: 
tutored/untutored status. The assumption underlying the analysis is that 
psychoeducational variables other than tutored status would be randomly 
distributed in both populations. The objective of the analysis was to 
determine the staying power of the Upswing effect on reading level achieve- 
ment compared with the "normal" progress of the control group. 

Variables and Data Sources for the Analysis of Project M anagement 
Strategy and Training" 

The criteria for this part of the evaluation all had to do with 
the satisfaction of participants. There were no subdivisions of manage- 
ment and training approaches within cities; further, because of the numerous 
undefinable environmental differences between cities, we did not feel it 
would be valid to evaluate the cities' often divergent methods based on 
changes in the children. 
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Table 3 states the variables of the management and training analysis, 
their measures, and the sources of measurement data. All measures Included 
In the table are subjective but one — for effectiveness of teacher training 
In how to Identify minimal learning difficulties (dependent variable B) • 
The measure In that case was what the test data showed about the Initial 
characteristics of the children teachers selected for Upswing. 

One additional variable was considered In the analysis of management 
strategy and training — volunteer attrition. The attrition analysis was 
performed separately, because attrltees may be a separate population whose 
opinions about a project should not be mixed In with the opinions of those 
who did not drop out. Nevertheless, rate of attrition may say something 
Important about recruitment, project operation, or both. Attrition was 
analyzed In terms of percentage losses, timing, and the reasons for leaving 
given by those who dropped out, considered in the context of project structure 
and procedures. 

Statistical Techniques 

Tutoring Effects on Children , As a starting point for the final 
analysis, the distributions and basic statistics of pretest results were 
compared for tutored and untutored children to ensure that they were similar 
initially in the characteristics under study (tested reading level, self-esteem, 
visual-motor integration) and in background of basic knowledge as a proxy for 
school-relevant family background. The group of children was partitioned on 
both tutoring status and location of project (*'city'*) . The latter classifi- 
cation variable was applied to ensure that no city was for some reason changing 
the nature of the overall distributions. The Student's T-test was used to 
che-'k the significance of differences between the mean initial test scores of 
all possible combinations of status/city groups. F-ratios were computed to 
see if any groups were distinguished by magnitude of variance. For both T-tests 
and F-tests, a significance level of 0.05 was adopted (i.e., it was decided to 
reject the null hypothesis that there was no difference between groups in mean 
or in variance if a = 0.05 or less).^ 



^ The information provided by the Student's T-test was very generally out- 
lined for readers who are not familiar with the procedure, in the description 
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The next step in the analysis was to look In the same way at change 
scores for each test* ("Change score'* Is used to refer to the difference 
between post-tutoring test score and pretutorlng test score,) Through this 
step, the analytical procedure was much like that used In the preliminary 
analysis, except that city was used as a classification variable In the final 
analysis. City was used as a classifier, despite the fact that the child 
selection method was the same for all cities, because the data Indicated that 
different groups of children were drawn. This may have been true In the first 
year of Upswing, but the preliminary analysis procedure was not sensitive 
enough to detect It. 

Beyond this point, the final analysis took a different direction 
because of what was learned In the preliminary analysis. The final evaluation 
did not pursue Identification of the Impact of psychosocial factors such 
as volunteer-teacher relationship, etc. It was decided that although we 
believe this Is a most Important area for research, such Inquiry would require 
attention focused on the development of stronger psychosocial Indicators 
through careful attitude scale development. There was not time or budget 
for such an effort as part of the current Upswing evaluation. 

Another Important change was to drop multiple linear regression 
analysis and Instead use analysis of variance with a covarlance design, 
for exploration of the complex simultaneous Influences of the Independent 
variables un the criteria. 



of the preliminary analysis. The F-ratlo, a product of one-way analysis 
of variance. Is an Indicator of the relationship between score deviations 
from the mean within groups and score deviations from the mean between 
groups. Without getting elaborate about how the algorithm works, If the 
variance (calculated from the deviations of Individual scores from the 
mean) within groups Is small In relation to the variance between groups, 
one can concl'ide that the groups represent different populations. A sig- 
nificance lev l, vhlch takes Into account the number of observations (In 
Upswing's case test scores) In each group, can be calculated that Indicates 
the percentage probability that differences between groups were random. 
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Analysis of variance Involves dividing up the total variation of 
the dependent variable Into Its component parts* These component parts 
are determined by the number of Independent variables being considered, 
and how they are classified. For Upswing, the design was kept simple. 
"Status'' always was used as a classifier with each of the other Independent 
variables In turn. For example, the observations on a dependent variable, 
say, change In reading test score, were grouped as follows: change scores 
for tutored females, untutored females, tutored males, untutored males; 
as another example, tutored children with low scores, mid-range scores 
and high scores on the TOBE, untutored children who scored In those cate- 
gories on the TOBE. The procedure then looks at the differences In variance 
between those groups versus their combined variance, and produces an F-ratlo 
Indicative of the probability that the groups are from the same population 
or from different populations. 

The covarlance design adds another refinement. It adjusts the 
dependent variable (or varlate) for the effect of an independent variable 
(the covarlate) that may have nothing to do with treatment but, nevertheless, 
enters into the treatment result. In the case of Upswing, we decided to 
adjust change in test score for the effect of the covarlate, initial test 
score, because of the strong Inverse correlation of these two variables. 
The net result is an Increase in the clarity of the findings. 

The final statistical procedure used was correlation analysis as a 
means of considering the relationships between dependent variables. Of 
particular Interest was the relationship between change in self-esteem and 
change in reading test score, which, it was hypothesized, would have a 
reasonabl> high positive correlation. 

FoltoU-Up Analysis. For the analysis of tutoring carryover effects 
after a year without tutoring, essentially the same techniques were used 
as for the analysis of erfects of the second year of tutoring. There were 
only two differences. First, three groups of children were Involved; the 
tutored group was split in the first year into children who worked with 
trained tutors and children who worked with untrained. Although training 
status of the tutor had no apparent effect on the children in the first 
year, the follow-up analysis took a look at the two groups separately, to 
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make sure. We thought the tutor training status variable might have some 
influence on, for example, type of class assignment in the second year, 
since teachers generally believed trained tutors were more effective. 

The other difference in follow-up analysis procedure was that it 
did not focus on change in test results, although change was considered. 
We worked with age-adjusted standard scores on the reading test, which 
would not necessarily be expected to change in the absence of "treatment." 
Although possible residual effects of treatment were investigated, the main 
question about reading was not how much children increased their rates of 
progress in the year following Upswing, but whether the children tutored 
in Upswing maintained the edge in standard score that they had established. 
There were no baselines for the other criteria used in the follow-up analysis. 
In the case of self-esteem, or class standing, for example, the analysis 
simply looked for significant differences between the children who were 
tutored in Upswing and those who were not. 

Project y.anaaenent Strategy and Training . This part of the final 
evaluation was quite straightforward. For the analysis of tutor and teacher 
role satisfaction and perceptions of training, rating scales were designed 
on a modified Likert format. These satisfaction ratings were cross-tabulated 
with data on the independent variables that were hypothesized to influence 
satisfaction. The evaluation team's subjective views of project organiza- 
tion and the training programs were used to interpret these results. 
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lY. ANALYSIS OF THE EFFECTS OF TUTORING ON CHILDREN 



This section compares data on the tutored and untutored children 
who were involved in Project Upswing, in an attempt to determine the 
value of tutoring. The section is divided into four major parts: 

• A review of findings about tutoring effects 
in the first year 

• An examination for residual effects among 
first-year children after they had been out 
of the project for a year 

• An analysis of the effects of involvement 
in the project on the new group of children 
tutored in the second year 

• Conclusions about the impact of the project 
over both years. 

SUMMARY OF FINDINGS FROM THE FIRST YEAR OF UPSWING 

Children tutored in thf first year of Upswing made better progress 
in reading than the comparison or control group of children who were not 
tutored. The gains on the Wide Range Achievement Test (WRAT) , reading 
subtest, were modest for both tutored and untutored children, but sig- 
nificant in relation to the standard error of the test. 

The initial test means for all Upswing groups fell into the lew 
average range (80-90 points on the WRAT), with very small standard devia- 
tions. Thus the project began with a total group of children whose 
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reading difficulties apparently were not severe and who were very similar 
to each other in level of reading skill. On the post-tutoring test, all 
group means (for children tutored by trained volunteers, untrained volun- 
teers or not tutored) fell in the average category of WRAT standard scores 
(90-109 points). The mean gain for children with trained tutors was 7 
standard score points; the mean gain for those with untrained tutors was 
8 points, and the mean gain for untutored children was 4 points. The 
difference between the amounts of gain made by tutored and untutored children 
were found to be statistically significant. Figure 1 shows the relative 
rates of progress. 

Children who started with lower test scores tended to make 
greater gains than children who started higher. It appears that, on a 
group basis, some kind of ceiling on progress was operative — perhaps 
expectancies c!: tutors and teachers for the reading skills of children 
of Upswing age. 

Mone of the children improved their visual-motor integration skills 
in the first year of Upswing. They started and ended the school year with 
low skills for that age. Visual-motor integration (as measured by the 
Beery-Buktenica test) and reading ability appear, for this population, 
to be separate domains. It is possible that visual-motor integration 
problems were easy for teachers to observe and contributed to the child 
selection for Upswing as much or more than low reading ability. If so, 
the low correlation between reading improvement and visual-motor integra- 
tion gains would indicate that selection could be improved by concentrating 
on reading and ignoring visual-motor integration, if reading Is to be 
maintained as the primary criterion variable. 

Tutors and teachers both believed that Upswing tutoring was 
especially beneficial to children's self-esteem. Moreover, change in 
self-esteem was one of the two variables most strongly associated with 
increase in reading test score. (The other variable was related to the 
confidence of the tutor.) There was no objective measure of self-esteem 
In the first year of Upswing, and it was not possible to make comparable 
observations of that characteristic in control group children. 
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(First Test)* 
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JAN 
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Time 
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APR 



MAY 
(Final Test) 



'Tosting continued through January in some cities; thus 
the mean starting point of both groups is inflated to the 
extent that classroom instruction and tutoring (for the 
experimental children) increased the scores of the children 
children who were tested late. 



FIGURE 1 . RATE OF PROGRESS IN READING AS MEASURED 
BY WRAT: TUTORED VERSUS CONTROL CHILDREN 
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Change in children's self-esteem presented itself as an intriguing area 
for further study; it appeared to be quite important, but the data 
available were limited. 

DESCRIPTION OF CHILDREN INVOLVED IN THE UPSWING FOLLOW-UP 

Each project located all children from the first year of Upswing 
who remained in a local school system, for follow-up after a year without 
Upswing. There were, for all projects combined, 242 children involved 
in the follow-up: 123 former tutored children and 119 former control 
children. Those numbers represent about half of the tutored group who 
still were in Upswing by the end of the first year and about three-qudrters 
of the control group. Table 4 gives a breakdown by city and child status 
vis-a-vis an Upswing tutor. 

The mix of boys and girls was essentially the same in the three 
comparison groups. The children in the three groups also were similar 
in age distribution. Tables 5 and 6 present the data on sex and age, 
respectively. These variables were checked to ensure that their influence 
did not obscure any effects of Upswing tutoring. Not only were the com- 
parison groups similar enough in sex and age composition to preclude that 
possibility, neither sex nor age differences were found to be associated 
with differences in the criterion areas. There was only one minor excep- 
tion to this finding— girls tended to make slightly greater gains in 
reading test score over the follow-up year, as is documented in the dis- 
cussion of reading outcomes. 

FOLLOW-UP OBJECTIVES 

The follow-up was conducted to find out whether: 

1. Tutored children would maintain their reading 
achievement edge over a year without Upswing 
tutoring. 

2. Children tutored in Upswing would indicate a 
different level of self-esteem than control 
group children on an objective test. 

3. Tutoring had an effect on the classroom assign- 
ments of children for their second year in ' 
school. 
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TABLE 5 



SEX OF CHILDREN INVOLVED IN UPSWING FOLLOW-UP 



Status in Project Upswing 


Male 


Female 


Total 


Tutored by trained 
volunteer 


39/55% 


32/45% 


71/100% 


Tutored by untr lined 
volunteer 


29/56% 


23/44% 


52/100% 


Control group 


67/56% 


52/44% 


110/100% 


Total 


135/56% 


107/44% 


242/100% 
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4. Tutoring had an effect on children's later 
needs for special educational services such 
as remedial reading, 

5. Tutoring had an effect on children's class 
academic standing in their second year in 
school, 

6. Tutoring had an effect on children's class- 
room behavior. 

1 * Tutoring had an effect on children's self- 
confidence demonstrated in school in the 
second year. 

8. Tutoring had an effect on children's 

adjustment to school as demonstrated by 
rate cf absenteeism in the second year. 

FOLLOW-UP PROCEDURES AND DATA SOURCES 

The children who could be located were administered two individual 
tests: the WRAT reading subtest and the "Funny Faces" measure of self- 
esteem. The children's WRAT scores from the end of the first year (May 1972) 
were taken as the baseline measute of reading skill. There was no base*^ 
line for self-esteem. All children were follow-up tested at the end of 
April or in May 1973. The examiners were project staff, all of whom had 
training and experience in individualized test administration. 

The children's teachers in the current school year were asked to 
give information about the children relative to the last six follow-up 
objectives listed above. The teacher's observations were recorded on a 
form, "Follow-Up on Children Tutored in the First Year of Upswing'' (copy 
in Appendix B) . The form either was completed by the teacher as a question- 
naire or completed by a project staff member in a personal interview with 
thp teacher. 

STATISTICAL HYPOTHESES 1 

In general, the follow-up analysis looked for differences in 
distributions of results for former tutored children and former control 

^ All hypotheses except the last are stated positively because the null 
form may be confusing to some readers. 
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children in the eight criterion areas listed previously. The hypotheses 
were: 

1. That children who received Upswing tutoring 
would make higher reading test scores than the 
control group after a year without Upswing tutoring, 
with a difference in group means significant at the 
0.05 level or better and a variance ratio significant 
at the 0.05 level. 

2. That tutored children would score higher than 
control children on the test of self-esteem, with 
difference between means and variance ratio both 
significant at the 0.05 level. 

3. That there would be a positive relationship 
between the follow-up reading and self-esteem, 
test scores with a correlation coefficient of 
0.30 or higher. 

4. That there would be a positive relationship 
between change in reading test score and the 
follow-up self-esteem test score, with a 
correlation coefficient of 0,30 or higher. 

5» That, for all teacher-measured variables, the 

distributions of responses would differ for tutored 
and control group children with a significant 
variance ratio (a » 0.05), 

6. That there would be no statistically significant 
difference (a « 0.05) in any of the follow-up 
criterion areas between children who had been 
tutored by trained Upswing volunteers and those 
who had been tutored by untrained Upswing volunteers. 

FOLLOW-UP RESULTS 

In this description of results, the reading and self-esteem 
criteria are treated first, separately. Then the second- year teachers' 
observations about the children are presented. The interactions among 



follow-up variablevS are discussed next, and conclusions are dravm about 
the follow-up results. 

Comparison of Reading Levels of Tutored and Untutored Children After 
A Year 

Figure 2 shows that the tutored and control children who could bo 
followed held their own during their second year In school. The pre and 
post means placed tutored and untutored alike at the low end of the 
average range on the WRAT (90-109 standard score points). There was about 
a two--polnt decline In standard score for the tutored group, but this is 
not significant in relation to the standard error of the WRAT. 

The standard deviations of the two groups also point up their 
similarity in both initial and final reading test score distributions: 

Tutored Untutored 

Pretest 9.90 9.19 

Post-test 10.29 10.48 
The standard deviations are consistently lower than the 15 points found in 
the normative population. This indicates that, as expected, the Upswing 
groups were more homogeneous than a normal population. The Increase in 
standard deviation on the follow-up final test also was to be expected 
since environmental differences such as schooling, experiences, or matura- 
tion, cause greater variance in children's reading skills over time. A 
larger Increase in standard deviation would be expected for a normal sample. 

It should be noted that the data in Figure 2 exclude the reading 
post-test scores of 26 children because there was no baseline measure for 
them; these children were not tested at the end of the year of Upswing 
tutoring. Their ''post*' scores were checked to get at least a partial view 
of the nature of bias that might have been Introduced by their omission 
from the sample. The 26 children Included 16 who were tutored (10 by 
trained volunteers, 6 by untrained, and 10 from the control group. The 
status group means for the 26 were higher than the means for the groups 
with complete data; however, there was a great deal of variance in the 
excluded scores. The 10 children from the Upswing control group had a 
higher mean reading post--test score than the 16 who received Upswi g tutor- 
ing, consistent with the trend for the larger follow-up groups. 
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Rate cf Projiress in Reading in the Fotlou^Up Year . Both the 
tutored and control groups increased their rate of progress in reading 
during the first year of Upswing tutoring as shown by the rising slope 
of the lines in Figure 1* The increase in rate was significantly greater 
for tutored children. In the follow-up year, thare was no difference in 
the rates of progress of the two groups. In fact neither increased its 
rate of progress at all. Both simpl; held their own at the pretest level. 
Since the WRAT is age-adjusted, an increased rate of progress is indicated 
by a gain in standard score. If a child's standard score remains the same 
from test to test over time, he is progressing at a uniform rate. The 
''average" child would be expected to obtain a standard score of 100 each 
time he is tested regardless of elapsed time or g* ade level. 

The standard deviations of change scores for the two groups showed 
chat some children were increasing somewhat in rats of progress, while 
others were retrogressing. Those values were almost identical: 7.16 for 
tutored children and 7.45 for untutored children. This result is another 
indication of the close similarity of tlie tutored and untutored groups' 
reading skills. In relation to the mean change for the groups (-2.3 points 
for tutored children and -0.5 points for untutored children), the standard 
deviations represent some spread. In relation to the range of possible 
change, however, the standard deviations are quite small, indicating that 
nothing spectacular happened to the reading skills in any part of either 
group. The change that occurred was negatively correlated with pretest 
score (r = -0.3, statistically significant at the 0.001 level). That is, 
children who started with lower test scores tended to show greater score 
gains on the final test. 

DifferenaeB in Children's Reading Levels From City to City . Know- 
ledge of the city in which a child lives iSf in the case of the Upswing 
follow-up, a better indicator of his Wl^AT score than knowledge of his status 
vis-a-vis an Upswing tutor. Table 7 shows, for example, that San Francisco 
children averaged roughly 10 points lower in pretest score than Denver children 
or St. Louis tutored children. These differences in starting score in.lu'^nced 
differences in change score. The influence of initial score — the covariatt — 
was previously pointed out: children who started lower tended to make 
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PRETEST WRAT SCORE AND CHANGE IN SCORE OVER THE 
FOLLOW-UP YEAR BY CITY AND STATUS 



(1) 


(2) 

Mean Pretest 


(3) 

Mean Point Change in 
Standard Score Pre to Post 


Status Group, by City 


otanaara ocore 


(a) 

Unadjusted 


(b) 
Adjusted 


Denver: 








• Children who had 
trained tutors (i) 


Q c c 
y t) . 0 


-2.2 


-1.2 


m Children who had 
untrained tutors (U) 


95 .9 


-4 ? 


-'^ 7 


• Control arouD (C) 


97.0 


-0.2 


-1 .5 


Ovf nrrl • 








• T 


91.9 


-2.1 


-2.2 


• U 


92.1 


-3.6 


-3.7 


• C 


92.7 


-2.3 


-2.3 


St. Louis: 








• T 


97.3 


-4.1 


-3.4 


• U 


97.4 


-1.6 


-0.9 


• C 


90.0 


-1.5 


-1.9 


San Francioco 








• T 


86.4 


+3.0 


+2.0 


• U 


86.3 


+0.2 


-0.8 


• C 


88.3 


+3.9 


+3.2 
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greater gains* As Table 7 indicates (column 3a), San Francisco children 
were the only children, regardless of status group, whose mean change in 
WRAT score was in a positive direction. Their relatively lower pretest 
scores account for part of this difference. The effect of adjusting for 
the covariate (column 3b) is to decrease the amount of positive gain 
indicated, giving a clearer picture of the influence of "city." Column 3 
of the table also shows that when amount of change is adjusted for pretest, 
the relative positions of the other city/status groups, in terms of how 
much their mean scores decreased, also changes. In a sense one can say 
that those who started higher had more to lose, so that adjustments for 
starting level reduces their amount of loss relative to those who started 
lower. 

The foregoing rather complicated exegesis may be interpreted in 
essence as follows: It appears that city possibly had some influence on 
what happened to children's reading skills in the follow-up year. This 
influence is attributable to a combination of child characteristics, in- 
cluding pretest level of skill, anc environmental characteristics that the 
Upswing evaluation cannot define. When we controlled for the impact of 
child's starting level, the influence of city on change in reading level 
over the year became miniscule. This is attested to by the fact that, on 
the final follow-up test there was no significant difference between 
the means of any two city/status groups or between the means by city for 
all children combined. 

Diffevenc^es in Reading Lev&l Betueen Boy 8 and Oirla . Girls 
typically have been found to progress faster in the early years of school, 
and there wa^ some tendency for girls involved in Upswing to reflect this 
early advantage. Overall (without regard for status group) the pretest 
means for boys and girls v;ere almost identical. However, girls tended 
to gain more or lose less in standard score than boys over the follow- 
up year. The margin was quite narrow; sex acc< unted for only about 2% 
of the variation in change in reading score. Still the difference was 
enough to produce a significant F-ratio for the boys versus girls. Upswing 
status continued to have no apparent bearing on reading. Girls, regardless 
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of whether they were tutored by trained volunteers, untrained volunteers, 
or were not tutored, tended to increase their final test scores or to lose 
fewer points on the final test. Figure 3 compares the distributions of 
change in reading test score for boys and girls. Again, it should be 
remembered that no change means no change in vote of progress; it does not 
indicate lack of development of reading skills. 

The preceding Table 6 (under "Description of the Children .•.") 
shows that, for all cities combined, the ratio of boys to girls was almost 
identical in the tutored and untutored groups. There were imbalances in 
Denver and San Francisco, but the data indicate that they do not affect 
the essential point; namely, that although sex of child appears to have 
had a very minor influence on follow-up results, the sex variable did 
not override the status variable to obscure any influences of tutoring. 

Comparison of Follow-Up Groups on Self-Esteem Test Results 

There were no differences between any two of the follow-up groups 
of children in measured level of self-esteem at the end of their second 
year in school (Figure 4). The means for the three groups fell toward the 
low end of the average range. Although the standard deviations were fairly 
large in relation to the range of actual test scores, +1 standard deviation 
places the children within the borderline to average range of the test. 
(Score categories were established in a pretest involving all first-graders 
in an elementary school — 59 children — as the normative sample.) A total 
of 13 Upswing children did not take the self-esteem test: one from the 
group tutored by trained Upswing volunteers, seven from the group tutored 
by untrained volunteers, and five from the control group. It is unlikely 
that their scores would have changed, appreciably, the results shown in 
Figure 4. 

Diffevnnoea in Self'-Esteem From City_to Citif . The self-esteem 
scores of the three follow-up groups within each city were not so uniform 
as the WRAT scores. Nevertheless, status still was not a significant 
variable at the individual city level. There were some comparatively large 
differences between certain groups from city to city, but the pattern 
found in the WRAT scores (consistently lower or higher scores iu a given 
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FIGURE 3. MALE-FEMALE COMPARISON OF CHANGE IN 
WRAT SCORE OVER A YlilAR WITHOUT TUTORING 
(Percentages plotted at the mean values for the change categories) 
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city) was not evident in the self-esteem scores. The F-ratio indicated 
that the variance between city/status groups was significant (i.e., that 
certain groups apparently represented different populations in terms of 
diQtHbutioyi of self-esteem). However, the Student's T-test applied to 
all possible pairs of city/status groups indicated that all differences 
between means on the self-esteem test were insignificant. 

Comparison of Follow-Up Groups Based on InfoYTnation From Their Second- 
Year Teachers 

Upswing status made no appreciable difference in any of the child 
characteristics about which the teachers were queried at the end of the 
follow-up year. 

r^pt? of Class Assignment for the Ye^ar After Upswing . It was 
hypothesized that status in Project Upswing might have some bearing on 
the type of class assignment children received for their second year in 
school, since the tutored children tended co gain more in reading and 
since teachers tended to regard Upswing tutoring as beneficial. Tliis 
hypothesis assumes, of course, that class assignments are not random 
but are governed by achievement level, at least in the case of retention. 
It further assumes that reading proficiency is the achievement indicator 
given greatest weight, at least in the primary grades. 

Table 8 shows that, among the children who could be followed. 
Upswing tutoring had no important bearing on placement for the next school 
year. The table also shows that data on type of class assignment by 
themselves would suggest that Upswing children on the whole were con- 
sidered a below-average group # Placement in a corabmaticn first and 
second grade class made up primarily of children with learning difficulties 
would seem to be a form of retention; the import of placement in a com- 
bination class of average or above-average children is less clear. (Only 
one child was reported to be in an above-average combination class.) Ex- 
cluding children in the latter, more ambiguous category from the retention 
group, the retention rate still is about 30%, which seems quite high. In 
addition 10% to 15% of all the Upswing children were in second ^. grade 
classes made up primarily of children with learning difficulties. Only 
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about half of all the Upswing groups were clearly promoted to normally- 
distributed or above-average classes. 

Table 9 shows that there wpre differences in assignment pattern 
from city to city. This probably reflects to some extent differences in 
types of classes available and also dxtferences in educational philosophy. 
The highest percentages of children were retained in Oxford and» more so, 
in St. Louis. Denver had a considerably higher percentage of normal second- 
grade placements than any other city. 

There were some differences between status groups within cities, 
but the number of children per group are so small under the three-way 
classification (city x status x type of assignment) that conclusions about 
such differences are tenuous. Differences mostly appear to be random, 
but tend to occur more between groups tutored by trained versus untrained 
volunteers than between tutored versus untutored children, except in 
St. Louis. The data suggest a possibility that there may have been greater 
tendency in St. Louis to retain former control group children in first 
grade classes, while the alternative for former tutored children was more 
likely to be a combinaf.ion first and second grade class normally dis- 
tributed in achievement level. 

3pe(yial Sevrrioes Given in the Follcw-Up Year. Eighty-six of the 
242 children in the follow-up were reported to have received one or more 
kinds of special educational service during their second year of school. 
The most commonly received services were (1) tutoring in a subject other 
than reading, (2) remedial reading, and (3) tutoring in reading. Eighty 
percent of the children who received special services had remedial reading 
or a reading tutor (in addition to other kinds of helD in many cases). 

It was hypothesized that Upswing tutoring might make special 
services, at least in reading, unnecessary for many children in their 
second year of school. However, as the data in Table 10 indicate, Upswing 
status was not related to receipt of services. There was virtually no 
difference between tutored and untutored children in any category except, 
possibly, speech therapy. The difference there occurred because about 
three times as many children who had worked with trained Upswing tutors 
received speech therapy in the follow-up year as children who had untrained 
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tatorc or no tutor • We can only speculate about the reasons for this. 
It appears that teachers may associate such problems as speech impairment 
with learning difficulty. It also appears that there was a tendency to 
assign the children perceived as having the greatest difficulty to the 
experimental group and, furtner, to trained tutors since they were regarded 
as most effective. Since speech impairment is a readily apparent problem, 
more speech-impaired children may have been perceived as in greater need 
of strong assistance. 

Table 11 shows that there were differences between cities in types 
of special services offered and numbers of children served. This was to 
be expected because of differences in school system budgets and the involve- 
ment of the communities in providing volunteer aid in the schools. Con- 
siderably more special services were provided in Oxford and San Francisco, 
and the number of children who received tutoring in the latter city may 
indicate the contribution of the city's school volunteer organization — 
the San Francisco Education Auxiliary. Considerably fewer special services 
were provided in St. Louis, perhaps because of limited budget. 

Generally, about the same percentages of former tutored and untutored 
children received special services within each city. The only noteworthy 
exception was that in Oxford a considerably larger proportion (58%) of 
children who had worked with trained Upswing tutors received special 
services than children who had untrained tutors (33%) or control group 
children (39%). Data on different types of services partitioned by both 
status and city are not appropriate for comparison since numbers of children 
in the comparison groups become so small. 

.7^aaa Standing. Teachers were asked to evaluate the former Upswing 
children's class standing at the end of the follow-up year. Figure 5 
illustrates that there were virtually no differences on this measure be- 
tween the Upswin^^ status groups. The figure also shows that children tended 
to the low side In class standing. 
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Since there were significant differences in reading post-test 
score distributions from city to city, the possibility was considered 
that there might be city differences in teacher evaluation of children's 
class standing. From Table 12, that did not turn out to be the case. 
The data suggest a marginal difference between St. Louis and the other 
cities; however, even though fewer children there fall in the lowest 
class standing category, the general trend of average or below average 
standing obtained. There were no significant differences in mean or 
variance between status group distributions on class standing within city 
and from city to city. It is possible (even probable), given the known 
sampling bias, that real Upswing gains have been obfuscated. 

Clc33roon Behavior . Teachers indicated that former Upswing control 
group children, overall, exhibited slightly more disruptive classroom 
behavior than either group of tutored children (Figure 6).^ This result 
can be traced to the combined effect of differences in two cities. Denver 
and St. Louis children, especially the former, presented more behavior 
problenjs, as shown in Table 13. In both cities, more frequent disruptive 
behavior was noted among control group children. A counter trend occurred 
in Oxford; however, it was not strong enough to neutralize or override the 
effect of the other two cities on project-wide results. 

oelf-Confidenoe Demonstmted in School. The self-confidence measure 
was obtained by asking teachers to rate children on a three-point scale 
where: 1 = child generally unsure of himself 

2 = average 

3 « child quite sure of himself. 

The children were rated in the following areas: 

• Friendship with other children in class 

• Participation in group activities 

• Approach to schoolwork 

• Relationships with teacher 

• Relationships with other adults. 



It should be noted that nonresponse to the query about classroom behavior 
was sufficient to raise a question about the validity of this finding. 
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The individual item scores were tallied and also were summed to yiell an 
overall score* 

Figure 7 illustrates that Upswing status had no influence on this 
measure of children's overall self-confidence that was discernible by 
their second-year teachers. The results for individual items all were 
virtually the same as the summed results. The distributions of overall 
and item self-confidence scores were about the same in each city as the 
distribution by status for all cities combined (represented in Figure 7). 

It is interesting to note that over two- thirds of all groups 
were considered average, with a significant minority below average. These 
overall findings agree with the self-esteem test findings, but the two 
measures do not correlate highly. Clearly we are dealing with two separate 
'^.onstructs of self-esteem. One, the test is a standard set of criteria 
for all children, and the other, teacher judgment, applies separate 
criteria to each child according to the teacher and his/her observational 
relationship to the child. Both measures have their place, but the fair- 
ness of a standard set of criteria is perhaps a more useful tool for this 
evaluation. It also appears, from the statistical associations between 
the teacher measures of self-confidence, class standing, and classroom 
behavior that the latter two variables entered into the subjective self- 
confidence estimate in ways that, on the basis of self-esteem test results, 
may not have been warranted. 

Rate of Absenteeism * The range on number of days absent from 
school was 0-60, with a total follow-up sample mean of 9.6 and a standard 
deviation of 9.9. There were modest differences^ between status groups in 
rate of absenteeism. Control children were a more heterogeneous group than 
tutored children in terms of school attendance; the former group included 
enough children who were absent very frequently to increase their mean 
number of days absent, particularly over the mean for children who had 
worked with untrained tutors, as Table 14 shows. 
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BASIC STATISTICS ON FOLLOW-UP CHILDREN'S RATES 
OF ABSENTEEISM FROM SCHOOI 

(Percentages based on number of children in each status group 
whose teachers provided attendance data.) 



Upswing Status 


Number of 
Children* 


Mean Number 
of Days Absent 


Standard 
Deviation 


Children who had trained 
Upswing tutors (T) 


63 


8.8 


8.0 


Children who had untrained 
Upswing tutors (U) 


43 


6.9 


5.8 


Control group children (C) 


109 


11.2 


11.9 


Total 


215 


9.6 


9.9 


* Nonresponse cases omitted. 
52U, 11 9C; grand total, 242 


Actual numbers of children were: 

• 


71T, 



70 
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Absenteeism was higher overall in Denver and San Francisco than 
in Oxford, particularly, and St. Louis, Table 15 presents the data by 
city. The rates in the first two cities were inflated by more absences 
among control group children in Denver, and among children who had worked 
v/ith trained Upswing tutors as well as the control group in San Francisco, 

The data on number of days absent suggest a possibility that Up- 
swing may have influenced school attendance to some modest extent, although 
characteristics of the city, or of the children in the city, were stronger 
influences. If Upswing tutoring had an effect, it might be attributable 
to added enjoyment of school because of the tutoring experience; it might 
also, or in addition, be attributable to the fact that the schools, vol- 
unteers, or both, frequently contacted the parents of tutored children to 
avoid volunteers making wasted trips to school. Parents of tutored 
children could have been made more conscious of school attendance because 
of the involvement with Upswing. 

Relationships Between Follow-Up Variables 

Indirect Effects of VvQWinq Statu s. The only areas in which Upswing 
status appeared to have any inJ... itnca in the follow-up year were classroom 
behavior and absenteeism. Control group children demonstrated slightly 
more disruptive behavior and tended to be absent from school more fre- 
quently than tutored children. However, the differences between the groups 
in these respects were marginal. 

Readincf and the Other Measures . Reading proficiency (as measured 
by the WRAT) and tested level of self-esteem appeared to be unrelated, as 
,idid reading proficiency and the teachers* estimates of children's self- 
'confidence in school. Thus the hypothesized relationship between positive 
self-concept and reading skill must be rejected for the Upswing follow-up 
population. 

In assessing children's class standing, teachers apparently took 
into account some elements measured by the WRAT, for there was a significant 
positive correlation between the two (r = 0.4). The WRAT results were not 
related to any other variable under study except the child's class assign- 
menr and whether the child received special ser/ices. The associations 
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TABLE 15 

CITY COMPARISON OF FOLLOW-UP CHILDREN'S 
RATE OF ABSENTEEISM FROM SCHOOL 

(Percentages based on number of children in each city 
vvhose teachers provided attendance data.) 



City 


Number of 
Children* 


Mean Number 
of Days Absent 


Standard 
Deviation 


Denver 


45 


11.8 


9.5 


Oxford 


63 


6.8 


7.7 


St. Louis 


59 


8.8 


9.7 


San Francisco 


48 


12.4 


12.2 


Total 


215 


9.6 


9.9 



* Nonresponse cases omitted. Actual total numbers of children were: 
Denver, 58; Oxford, 65; St. Louis, 70; San Francisco, 49; grand 
total, 242. 
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found with these variables were contrary to what one would presume to be 
expected • 

The decision to retain or to place a child in a learning difficulties 
class apparently was not based generally on deficiency in reading skill, or 
else the measure of reading skill used did not accord with the WRAT results. 
Table 16 shows that children who were retained tended to have slightly 
lower WRAT scores than children who were not, but the means for all groups 
fell at the low end of the average range, with small standard deviations* 
No significant difference was found in mean or variance of pretest reading 
scores between groups formed on type of class assignment ♦ 

Table 16 also gives the reading post-test basic statistics for the 
type-of-class groups. None of t?iese group means went up significantly; 
however, the mean for the group retained in first grade dropped signifi- 
cantly, indicating that these children lost ground in reading. 

Eighty percent of the 86 children who received special services 
had remedial reading or a reading tutor (in addition to other kinds of 
help in many cases) . The pretest WRAT scores of the 86 children tended 
to be lower than the pretest scores of those who did not receive any 
special services # Differences in pretest mean and variance for the two 
groups were significant* Those differences were maintained on the reading 
post-test, which indicates that extra help in reading in the second year 
of school generally did not result in improved skills. Figure 8 shows 
the pretest and final score distributions for the children grouped on 
receipt of special services. 

rypg of Class Assigy'/nent and Special Servioes. The percentage of 
children who were not retained and who received special educational services 
was twice as high as the percentage of retained children who received special 
services. There was no particular difference between the other class assign- 
ment groups in frequency of special services. Table 17 presents these data. 

Type of Class Assici^rnent and Other lleasur<^s . Type < / class assign- 
ment had no bearing on tested self-esteem, self-confidence demonstrated in 
school, classroom behavior, or teacher-assessed class standing. 
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READING TEST INSULTS FOR UPSWING FOLLOW-UP CHILDREN 
GROUPED BY TYPE OF CLASS ASSIGNMENT 



Type of Assignment 


No. of Children, 
% of Total 
Population!/ 


Reading Pretest 


Reading Post- Test 


First grade 


35 


X =90.5 


X = 84.3 




17% 


SD = 9.3 


SD = 7.4 


Combination 1-2 , 








• J 1 1*11 
primarily children 


24 


X = 89 .5 


X 88.5 


wit va learning 


12% 


SD = 7.6 


SD 8.3 


problems 








OOmDinaLlOn L'^ct t 








normally-distributed 


21 


X = 93.8 


X = 91.5 


or above-average 


10% 


SD = a . 8 


SD = 11.3 


class 








Second grade, 






X = 93.62/ 


primarily children 


24 


X = 93.2 


with learning 


12% 


SD - 11.1 


SD = 12.0 


problems 








Second grade. 


9B 


X = 93.7 


X = 94.5^ 


normally-distributed 


4 7% 


SD = 10.5 


SD = 10.5 


or above-dverage class 




Percentages based on 208, the total number of children for whom we had 
both WRAT scores and a response from the teacher on "-/pe of class. The 
total follow-up population included 242 children; there was no pretest 
WRAT score for 26 children and no grade report for 8 children. Percentages 
do not sum to 100% because of rounding errors • 

^ One child excluded because of out-of-range post-test score. 

^ Two children excluded because of out-of-range post-test scores. | 
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Receipt o^' Sv(?rri.al S evmar ^ and uth e r Variabtes . Children who 
received special services were on the low side in all follow-up measures 
except tested level of self-esteem and degree of disruptive classroom 
behavior. They obtained lower final WRAT scores, and lower class standing 
and self-confidence ratings from their teachers. 

LIMITATION OF THE FOLLOW-UP AlNALYSIS 

This analysis is seriously hindered by a nonrandom attrition of 
children in the tutored and untutored groups. Unfortunately it was not 
possible to track children who left the school systems that hosted Upswing. 

Many children moved away, and an analysis of test scores indicates 
that the follow-up population is not truly representative of the original 
groups of tutored and control children. This is particularly true of the 
tut^^red group, which went down by half. Moreover, the fact that, overall, 
two times as many tutored children as controls moved away indicates that 
there wer<^ important demographic differences between the two groups not 
detected in the first-year evaluation. These differences might be in the 
itinerant nature of family life, etc. The manifest effect was a differ- 
ential attrition rate. It also is puzzling why, counter to the overall 
trend, all of the control children in one city (San Francisco) remained 
while only about half of the tutored children in that city remained. There 
was no way to determine tie impact of differential losses from the compari- 
son groups. Thus it should be kept in mind that the follow-up results 
night be Quite d:i ff erent had it been possible to track all children from 
the first year. 

The impact- of this attrition can be partially assessed through a 
comparison of the mean reading scores for the total population (all children 
completing Upswing's first year) and the post-attrition subsample. This 
comparison indicates that the attrition was concentrated among the low 
scorers for the control group and the high scorers for the experimenta"* 
(tutored) group. The net effe.ct is to eliminate most differences. 



ERLC 



77 

89 



BEST COPY mmiE 

The self-esteem test was included in the follow-up on the assump- 
tion that initial level of self-esteem would be a randomly distributed 
variable in both groups, since the groups were supposed to be randomly 
drawn from a single population. The hypothesis was that if the two 
groups were comparable in self-esteem before Upswing, then differences 
after Upswing might be attributable to tutoring if it appeared that no 
unusual influences occurred in one or both groups during the second year. 
Post-test differences between the two groups did not occur. Differences 
Attributable to tutoring could have been wiped out because of attrition, as 
in the case of reading. However, since reading skills and self-esteem 
appeared to develop independently of each other in the Upswing population, 
there is no reason to assume attrition affected results in the two criterion 
areas in the same way. All that can be said is that both groups of children 
tended to be on the low side of average in test-observed self-esteem a year 
after Upswing. It remains unknown whether the project in its first year 
had any impact in this area and whether any greater benefits to tutored 
children endured. 

CONCLUSIONS ABOUT THE EFFECTS OF TUTORING OVER TIME 

It is difficult to make definitive statements about the durability 
of tutoring benefits because of the follow-up limitations just described. 
However, the analysis suggests the following about carryover effects: 

• The children who could be followed generally 
maintained their pretest levels of reading skill 
over the follow-up year (except for those re- 
tained in first grade) . If one can assume that 
the attrltee<^ from the follow-up population 
would have doi,e likewise, the tutored group 
would have maintained its edge; i.e., the 
positive effect of Upswing tutoring on reading 
would have been stable over the next year. 

• T'here was ncv.slgnlflcant difference between 
the tutored and untutored groups in level of 
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self-esteem. Moreover, the data give no reason 
to believe that there were differences between the 
two groups in this characteristic at the end of the 
tutoring period. Had there been a positive correla- 
tion between post-test reading score and self-esteem 
it might have been justifiable to speculate about 
differences between status groups being obliterated 
by attrition. However, neither the objective test 
of self-esteem nor the teacher assessment of self- 
confidence demonstrated in school showed any 
association with reading level in the follow-up 
sample. 

• The only areas of actual differences between the 
follow-nip sample groups were classroom behavior 
and absences from school. The differences were 
quite small — but control group children more 
commonly presented behavior problems in class 
and were more frequently absent from school. 
The follow-up analysis yielded several interesting findings that 
were outside the realm of the Upswing evaluation but nevertheless should 
be noted. One of these is the lack of effect, possibly negative effect 
of special educational services • The data here are somewhat ambiguous 
because the evaluation looked for effect on reading only and some children 
received special services in other areas. However, 80% of those who 
received any special service received either remedial reading or tutoring 
in reading (in addition to other kinds of help in many cases). The 
post-test reading score of children who received special services showed 
no improvement over their pretest scores. They remained at a level sig- 
nificantly lower than 'Children who did not receive special services. This 
brings up the possibility that Project Upswing might be more beneficial 
tu children with reading difficulties than the traditional remedial read- 
ing approach or than other tutoring efforts. 
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The negative effect potential is suggested by the fact that teachers 
evaluated children who received special services as lower in class standiiag 
and in self-confidence. There were significant differences in both mean 
and variance of these teacher ratings between the group of children who 
did and those who did not receive special services. This way ©uggest 
stereotyping. 

Another issue that seems worthy of further exploration was raised 
by the follow-up analysis — namely, the basis for decisions to retain 
children or to place them in learning-difficulty classes. It seems un- 
likely that such decisions are made randomly, yet, for the Upswing follow- 
up sample, they did not appear to have been based uj.on reading skill. 
Here, too, the data are not free from ambiguity. Certainly reading skill 
would not be the only factor considered in making class assignments. How- 
ever, It would seem that In the primary grades reading should be an Important 
factor, perhaps the most Important except for severe social immaturity. 

There was no significant difference between the reading pretest 
scores of children who were retained or were In "slow" classes and 
children who advanced normally for their years In school. One might 
question the validity of the WRAT, which was used to measure reading 
In the Upswing evaluation. Although the WRAT may not be the last word 
In reading tests. It was carefully developed and standardized; moreover, 
it Is a very straightforward n^^^iasure of ability to decode. There would 
not seem to be aaich room for argument about WRAT results; either a child 
can decode or he cannot (except of course for contingencies like illness, 
examiner-Introduced bias, etc.). Thus we found it surprising, in view 
of the predominance of "average" readers in the follow-^p sample, that 
such high percentages were retained or were in classes made up primarily 
of children with learning difficulties • We found It even more surprising, 
even distressing, that the retained children, at least, did not demonstrate 
significantly lower reading skill than the others. 
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Since the retained children apparently started out on an equal 
footing with the others in basic reading skill, it was especially dis- 
t* essing to observe tha^': those who were retained showed significant loss 
of skill by the end of the follow-up year. This loss was real in an 
absolute as well as a relative sense. The mean WRAT standard score of 
retained children dropped six points, with an even smaller standard 
deviation than for the pretest. 

The foregoing tangential findings certainly seem worthy of 
serious consideration by the school systems involved in Upswing and by 
the educators in general. Existing data on the value of special services 
and on the reasons for and effects of retention certainly should be studied 
and perhaps further research would be in order. 

DESCRIPTION OF CHILDREN INVOLVED IN PROJECT UPSWING'S SECOND YEAR 

There were 365 children who participated in the second year of Up- 
swing — 181 who had tutors and 184 who did not. The numbers of the two 
Upswing status groups (tutored/control) were virtually the same in all 
cities — A7 to 51 children in each group — except San Francisco, where there 
were 35 children in each group. The groups were reasonably well matched 
in each city (except for parameters later noted) . The term "city" has been 
used to partition the total sample for "by-city" comparisons to ansess the 
effect of gross environment on Upswing results. 

Sex 

Sixty percent of the Upswing children were boys (219) and 40% girls 
(146). The status groups showed about the same ratio of girls to boys as 
the total population, Tliere were some differences in mix of the status 
groups within cities. For example, in the Oxford tutored group and the St. 
Louis control group, the spilt was about 50/50, while in the Denver and St. 
Louis tutored groups, there were about 70% beys to 30% girls. However, since 
sex of child had virtually no influence on the criterion measures, these dif- 
ferences are not considered important. 

Ase; 

Most of the children were between six and seven years old. There 
was a moderate tendency for control group children to be a little younger as 
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shown in Table 18. This difference was not important in the analysis 
because the reading test results were converted to age-adjusted standard 
scores, and age within the narrow range of the Upswing children was found 
to be unrelated to the other criterion measures. 

Kindergarten Experience 

Table 19 shows that about 70% of the children for whom data were 
available attended kindergarten. The proportions of the two status f>roups 
who had kindergarten experience are virtually identical. It should be noted 
that there was enough nonresponse that these data may not be valid for the 
population. Ninety percent to almost 1007, of both groups of children in 
Denver and St. Louis (for whom there were data) attended kindergarten. This 
compares with about S0% to 90% of the San Francisco groups and only 16% to 
22% of the Oxford groups. 

Family Background 

The Test of Basic Experiences (TOBE) , General Concepts subtest, was 
used to obtain an indicator of elements of Upswing children's family back- 
ground that might bear upon the children's progress in school. A positive 
correlation of about 0.5 has been shown between the TOBE and the Home Infor- 
mation Scale (HIS) derived from Richard Wolf's Environmental Process Scale. 
These family background measures, the latter depending upon home Interview 
data, were designed to reflect such variables as amount of stimulation, 
quantity of educational materials, and parents' aspirations for their children's 
education. Thus the TOBE appears to provide a reasonable proxy for family 
background characteristics relevant to school achievement. According to the 
TOBE documentation, the test "undoubtedly reflects elements of socioeconomic 
status." 

Overall, the 350 Upswing children who took the pretest tended to be 
significantly below average in terms of what the TOBE General Concepts test 
measures. The Upswing population obtained a mean pretest score of 12.9, with 
a standard deviation of 4.1. The mean for the normative population (1,707 first 
graders) was 19.2, with a standard deviation of 4.4. The Upswing mean places 
the children in the 8th percentile • 
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There was no significant difference in mean or variance between che 
Upswing status groups, all cities combined. Mor was there any significant 
difference between status group means within any city. There were, however, 
significant differences between cities. All Denver children scores somewhat 
higher (X= - 15) than those in any other city, although the only statistically 
significant differences were between Denver and St. Louis tutored children and 
Denver control group children versus the control groups in Oxford' and St. Louis. 
It is difficult and not particularly important to make sense out of these 
differences. The important points to be made about the TOBE pretest results 
are two: 

a The results Indicate that Upswing children came 

from ''educatlonally-*deprived** family backgrounds 
t The results Indicate that initial differences 

between the Upswing status groups In family 

background can be considered inconsequential to 

the evaluation (i.e., our comparison groups are 

statistically equivalent). 

Academic Readiness 

The readiness inventory used in evaluating the learning difficulties 
of the Upswing children is divided into three categories of true readiness 
behavior. The categories pertain to visual-perceptual-motor behavior (such 
as tieing shoes, holding pencil/crayon, cutting with scissors, etc.), auditory 
perception (e.g., rhyme recognition, ability to understand verbal messages), 
and language and speech (development of speech patterns, production of sounds 
in correct sequence, blending, time required to speak or respond orally, etc.). 
In addition, the inventory covers writing and spelling, reading, and mathe- 
matics skills that go beyond readiness. 

The Inventory was uued (1) to help teachers structure their observa-* 
tlons of children in a consistent way on the behaviors traditionally associated 
with readiness fur school; (2) to help tutors understand their pupils* specific 
difficulties (teachers as well^ of course, knew the CARE results and were given 
help in interpreting them by project staff whenever such help was requested) . 
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It was Intended to use "he readiness components of the CARE In 
establishing the comparability of the tutored and control groups in behaviors 
related to learning difficulties. The instrument could not be used for that 
purpose^ however, because of its scoring mechanism. The means for both groups 
of children were outside the range of possible scores in all categories of 
the test. This occurred because teachers skipped so many items in completing 
the inventory, probably because (1) they described behaviors not yet relevant 
to the child (2) the child had no opportunity to demonstrate some behaviors, 
or (3) the child did not hava the problems represented. There was no provision 
for "not applicable," "don^t know," or "never'' (displays the behavior) responses, 
(The behaviors are stated negatively; e.g., "Has difficulty staying within 
lines when writing." The response choices are "Generally" and "Sometimes.") 
In addition to out-of-range means, the standard deviations of the scores were 
nearly as large as the range of possible points. 

OBJECTIVES OF THE SECOND-YEAR ANALYSIS OF TUTORING EFFECTS 

This part of the analysis of the second year of Upswing had the fol- 
lowing objectives: 

1. To verify the effect of tutoring on tested reading 
skill found in the initial evaluation. 

2. To obtain a more reliable measure of children's 
self-esteem and test the effect of tutoring on 
self-esteem. 

3. To determine if children's visual-motor inte- 
gration skills would improve under tutoring if 
tutors specifically directed part of their work 
with children to that goal. 

4™ To continue study of relationships between the 
three major criterion areas. 

DATA COLLECTION PROCEDURES AND SOURCES IN THE SECOND YEAR 

Children were identified by their teachers as candidates for Ui)cv;ing 
tutorin;;, and evaluated by the teacher on an acadiimic readiness inventory 
(the previously described Cegelka Academic Readiness Evaluation, or CAi?E). 
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The children were then administered a pretest battery that included two 
individualized Instrumenr.s : the mA7 and the "Funm Faces Came" (self- 
esteem inventory); and two individual- or small-group-mode instruments: the 
Beery-Buktenica test of visual-motor integration and the Test of Basic Ex- 
periences. (The same battery was administered at the end of the tutoring 
period. ) 

Teachers and tutors were asked for their opinions about the general 
benefits to children of Upswing tutoring on a questionnaire distributed near 
Che end of the tutoring period. The teachers and tutors also were asked for 
LiieLr assessments of both tutored and untutored children's self-confidence 
via "Student Profiles" distributed with the final questionnaires. These 
forms were mailed by on-site data coordinators or given to respondents at 
Upswinr, meetings. They were returned directly to the evaluator. The data 
coordinator and project staff in each city conducted follow-up by telephone 
or personal contact at the Upswing schools or in meetings as notified of 
nonrespondents by the evaluation. 

STATISTICAL HYPOTHESES USED IN THE SECOND-YEAR ANALYSIS 

The analysis looked at the distributions of measurements in the three 
criterion areas listed above, for differences between the groups of tutored 
and untutored children. The hypotheses were: 

1. That the tutored groups v;ould make greater gains 
in reading, self-esteem, and visual-motor integra- 
tion test scores over the tutoring period than the 
control group, with a difference between the group 
means for each test significant at the 0.05 level and 

a variance ratio significant at the 0.05 level (a = .05). 

2. That, for all tests, there would be a significant 
negative relationship between the children's pretutoring 
scores and the amount of gain shown on the post-test, 
with a correlation coefficient of 0.30 or higher, 

at 'J. - .05. 

3. That there would be no significant correlation between 
change in tested reading level and change in tested 
level of visual-motor integration skill, at -( = .05. 
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4, That there would be a significant positive rela- 
tionship between tested final level of self-esteem 
and change in both reading and visual-motor integra- 
tion score, with correlation coefficients of 0.30 

or higher, at a = .05. 

5. That there would be significant positive relation- 
ships between final self-esteem test score and both 
the teacher and tutor assessment of child self- 
confidence, with a correlation coefficient of 0.30 
or higher, at a = .05. 

RESULTS OF THE ANALYSIS OF TUTORING EFFECTS ON CHILDREN IN THE SECOND 
•YEAR OF UPSWING 

The results in each criterion area are presented separately with dis- 
cussion of influences of the independent variables that were studied. Then 
relationships between criterion variables are explored. Finally, conclusions 
are drawn about the second-year results, with reference to the first-year and 
the follow-up findings. 

The Chndren*s Reading Skills Before Upswing 

Only abouc a quarter of the Upswing children had Initial reading tatt 
scores that reflected notably deficient skills. About 35% scored In the Im/* 
average range » 40% In the average range, and 2% above average before tutoring 
began. The percentage of children in each score category is given ip Table 20. 
It should be remembered that tests do not measure all aspects of reading. It 
is quite possible for a child to know hov; to read but perform poorly in class 
because of shyness, etc. Such children may have been recomended to Upswing 
frequently, especially if they had other problems in class. 

It appears from Table 20 that, although Upswing's primary tutoring 
goal was to help children overcome reading deficits, reading or readlng<»related 
behaviors may not have been the primary factors in selecting children for the 
project. As will be demonstrated in this section, visual-motor integration 
problems may have had more to do ^::^.th children being identified for Upswing 
than reading problems. Also, it wac shown in the description of child char- 
acteristics at the beginning of this analysis that the children tested quite 
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low In basic experiences related to family background/socioeconomic status; 
evidently, these descriptors represent one or a cluster of primary selection 
factors. These attributes are all highly visible in children; generally, 
individual obser7;aticn or diagnosis is not necessary to detect symptoms of 
at least some alements of V>tl deficiency, and family background or socio** 
economic characteristics usually are evident In children's dress and language 
patterns. To determine whether first-grade children have acquired basic 
reading skills, some kind of organized individual diagnostic effort must be 
made* 

Sixty percent of the Upswing children did demonstrate low average 
or lower reading skills, and the Upswing analysis gives several reasons to 
believe that without the project they would have remained there ^ or declined. 
However, it is interesting that teachers apparently did not focus on reading 
problems when selecting children. Despite the "whole-child" approach that 
distinguishes Upswing from many tutoring projects, indications were that 
the participants believed that children were chosen for Upswing because of 
reading problems. 

Effect of Tutoring on Children's Reading Skills 

The grouping of scores into the WRAT interpretive categories, as in 
the preceding Table 20» obscures a critical difference between the tutored 
and control group children. Figure 9 reveals this difference, namely, that 
the children who were not tutored made higher scores on the reading test both 
at the beginning and end of the project. The pre- and post-tutoring dif- 
ferences between the groups, mean and variance, were found to be statistically 
significant. Both groups made significant progress in reading, and made 
about the same amount of progress (8 points in standard score); thus, the 
control group's initial lead was maintained over the year. These data 
suggest that: 

1, Children were not necessarily assigned to groups 
randomly, as was supposed to have been done. It 
appears that project staff must have been influenced 
in many instances to give tutors to children who 
demonstrated the greatest problems. 
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2. Some kind of "treatment'* was given control group 
children. The explanation for the consistent and 
substantial gains among control group children will 
be developed as the section progresses* 
The expected negative correlation was found between initial reading 
test score (r = 0.44, significant at the 0.001 level). However, this tendency 
war, not strong enough to reduce the margin between the status groups at the 
end of the year, even though tutoted children more commonly had lower initial 
scores . 

City Differences in Reading Test R&aulta. From a look at the data for 
the individual cities, one finds that the difference between the initial test 
score distributions of the comparison groups is attributable to children in 
St. Louis and San Francisco. As shown in Table 21, the control children in 
St. Louis had a mean reading pretest standard score 7 points higher than that 
of the tutored children. The San Francisco control group mean was about 6-1/2 
points higher. There was virtually no difference between the groups* starting 
levels in Denver, and the 2-polnt difference In Oxford, also in favor of the 
control group, was not statistically significant. 

From the last column of Table 21, the control group children In all 
cities except St. Louis obtained mean change scores slightly higher than the 
tutored children. The between-group differences in Denver, Oxford, and San 
Francisco were not statistically significant. The control childrer in St. 
Louis made a minimal mean gain of just under three points, slightly less than 
the mean gain made by all control children in the first year of Upswing (four 
points) and slightly more than the mean gain made by the St. Louis control 
children in the first year (one point). The control children In St. Louis 
started out with higher reading scores, and they tended to maintain the same 
level of functioning In reading over the school year, while tutored children 
tended to raise their reading levels and caught up with the control group. 
In short, no treatment effect among St. Louis control children la esd.dent* 

The St. Louis project model appears to account for that city's unique 
results. There, the second-year project was much closer to the original 
desifev. than the second-year project in the other cities. The St. Louis staff 
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visited the schools frequently, but their interaction was primarily with the 
tutors on an individual basis. Their involvement with teachers was primarily 
a ''Hello, are there any problems about Upswing,'' kind of thing. There was 
no formal training and minimal orientation for teachers. The point is that, 
although Upswing ran smoothly in St. Louis, the project apparently was not 
felt as strongly as an entity in the schools and did not involve teachers as 
much or in the same ways as the projects in other cities. The data indicate 
that teachers made the difference for the control group in other cities, and 
further, that the teacher effect can be attributed to Upswing. These obser- 
vations will be developed more fully through the remainder of the report. 

'}wri>ev of Houvs of Tutorim . The amount of tutoring children received 
varied fron 4 to 50 hours. Half of the children were tutored 35-50 hours; 
37% were tutored 20-34 hours. The Upswing data suggest that 20-2 ^« hours may 
be the critical amount for influencing reading skills. Children who received 
les3 gained only from 1-2 points (mean) on the post-tutoring WRAT* The amount 
of gain at the 20-24 hours mark Jumped to a mean of 9 points and remained at 
about that level regardless of additional hours of tutoring. 

It should be noted that factors other than tutoring time undoubtedly 
are Involved. For example, children who received very little tutoring and 
made negligible reading test improvement may have been absent from school a 
great deal because of illness or home problems. Still, a trend is evident 
in the data. 

I nfluences on Reading Achievement of the Independent Variables Selected 
for Study 

Eight independent variables were selected as feasible to measure and 
as having potential to influence reading test outcomes: 

1. Child's sex 

2. Child's age 

3. Whether child attended kindergarten 

4. Child's background of basic knowledge, an 
indicator of family characteristics relevant 
to school performance 
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5. Child's initial level of reading proficiency 

6. Child's Initial readiness skills 

7. Number of hours of Upswing tutoring child 
received 

a. Special services other than Upswing tutoring 
child received. 

Although the status groups were comparable on the other independent 
variables (except initial reading level), all were checked through analysis 
of covariance for influence on change in reading level (1) independent of 
Ups'/ing status ind (2) interactive with Upswing status. For example, (1) 
Without regarc for Ups-ring status, did children who received special educa- 
tional serviceij other than Upswing tutoring tend to make greater gains in 
reading than children who did not? (2) Did tutored children who received 
other special services tend to make greater gains than control group children 
who received special services? (3) Did kindergarten experience, starting 
level of basic experiences or initial level of self-esteem bear on progress 
in reading? The only such influence found was in the area of special services, 
specifically, remedial reading; its influence was small. • - • 

About a third of all the Upswing children received something outside 
the project (most commonly remedial reading or speech therapy). Tutored 
Upswing children more often got extra help than untutored, by a small margin 
(35% versus 29%). There were sharp differences between cities, but, within 
cities, except Denver, the school systems were even-handed in giving extra 
help to the two groups. In Denver, half of the tutored group, versus 27% of 
the untutored received extra help (thus the difference between comparison 
groups project-wide). Only six Upswing children in St. Louis received special 
services from the school system (four tutored and two control). 

There is a good argument that special attention of any kind may have 
far-reaching effects not necessarily logically related to the nature of the 
attention. Thus we considered impact on reading of special services without 
regard for type. No impact was found among either tutored or untutored Upswing 
children. 

We then looked at the inq)act of remedial reading only. This service 
was given to a total of 64 children: to 34, or 19%, of the tutored and to 
30, or 16%, of the untutored. The initial reading test scores of these two 
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subgroups were very similarly distributed and tended somewhat to be lower 
than the initial scores of the children who did not get remedial reading. 
The pretutoring mean score for the remedial group was 84 (in the middle of 
the low average range), with a standard deviation of 12.6. These data compare 
with a pretutoring mean of 87.6 for the total population~86.1 for all 
tutored and 89.3 for all control). 

There was a significant difference between the distributions of 
change in reading score. The mean gain for the remedial reading children 
was 9.8, with a standard deviation of 11.4. The mean gain for those who 
did not get this service was 7.7, with a standard deviation of 9.1. These 
data indicate that remedial reading tended to have a positive impact, but 
that impact was marginal. The frequency distributions indicated that some- 
what more children in the remedial reading group made great progress, as 
reflected in the slightly higher mean and larger standard deviation for 
that group. 

Comparing tutored and control group children who had remedial read- 
ing, the former gained 8.6 points in standard score on the final test (standard 
deviation 11.4) while the latter gained 11.3 points (standard deviation 11.3 
as well). Thus it appears that control group children tended to benefit a 
little more from remedial reading than those with Upswing tutoro. It might 
be a case of "too many cooks" for the tutored children* However, the 
difference is small. 

It appears that Upswing involvement (not necessarily having an Upswing 
tutor) was as effective, or nearly so, as remedial reading for most children. 
Further, there apparently was no advantage to having both an Upswing tutor 
and remedial reading, in fact, the combination apparently had a negative 
effect in some cases. 

The Independent Vczridbles and Initial Readincf Soothe. Among the eight 
variables at the beginning of this discussion were four that might have been 
expected to be related to pretutoring reading level if not to change in read- 
ing level over the year. These variables were: child's sex, v;hether the 
child attended kindergarten, child's background of basic knowledge, and initial 
readiness skills. The last could not be evaluated as explained previously. 
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Of the others, only background of basic knowledge was found to have any- 
thing Lo do with initial reading level as measured by the WRAT. There was 
just under 20% associated variation between the basic experience and reading 
pretests . 

Level of Self-Esteem Before Tutoring Began^ 

With data from all cities combined, there was no significant difference 
between tutored and untutored children in initial mean level of self-esteem. 
Both groups means fell in the "borderline problem" interval.^ Although there 
was considerable variance in the distributions (unlike the WRAT), the per- 
centages of children in each score category are roughly equivalent. Table 22 
shows that there was some tendency for control group children to score higher, 
but as just noted, the differences were not statistically significant. 

The Oxtord children had the lowest initial self-esteem scores, with 
a mean for both groups of about 8 (standard deviation roughly 16.5). Denver 
and St. Louis control group children had comparatively high initial means 
(18.2 and 17.3, respectively), which placed these children in the range of 
average self-esteem (16 to 35 points) before tutoring began. The Denver 
and St. Louis tutored groups obtained initial means of 15.1 and 10. A, 
respectively (borderline problem). 

The picture at the beginning of tutoring, then was a tendency toward 
below average self-esteem, mediated by considerable variation in scores 
(mostly in a negative direction). Substantial self-esteem problems were 
Indicated for about a third of both groups and "superior adjustment for 5% to 
7%. Oxford children scored low; and the self-esteem results in St. Louis go 
along with the reading results in Indicating nonrandom assignment of children 
and tutors (i.e., lower children appear to have been assigned to the tutored 
group) . 

^ San Francisco children are excluded from the self-esteem test analysis 
because the pretutorlng results were lost in the mail. 

^ The self-esteem measure— "Funny Faces Game'* — is still under development. 
However, it was pilot tested with all first-grade children in a Prince 
George's County, Maryland, public school. Using that group as a pre- 
liminary normative population, categories for score interpretation were 
established. The mean score for the normative group was 23, with a 
standard deviation of 11. The pilot test was conducted in September 1972. 
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TABLE 22 

COMPARISON OF PRETUTORING SELF-ESTEEM LEVELS 
OF TUTORED AND CONTROL GROUP CHILDREN 



Self- Esteem Score 


Status in Project Upswing . 


Total 


Category 


Tutored 


Control Group 


Superior adjustment 
{•io to 41; 


6/5% 


8/7% 


14/6% 


Average 
(16 to 35) 


46/36% 


50/41% 


96/38% 


Borderline problem 
(6 to 15) 


32/25% 


23/19% 


55/22% 


Problem 
(-5 to 5) 


22/17% 


27/22% 


49/20% 


Serious problem 
(-6 and below) 


21/17% 


15/12% 


36/14% 


Total 


127/100% 


123/101%* 


250/100% 


♦Rounding error. 
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Kindergarten attendance, family background (as measured by the teat 
of basic experiences), and initial reading level were related to initial 
self-esteem. Children who attended kindergarten had a mean pretest self- 
esteem score of 14.5, while children who did not had a mean pretest score of 
* 7.2. This result Is largely attributable to Oxford, where few children 
attended kindergarten and where the lowest initial self-esteem scores were 
recorded. These data are insufficient to conclude that kindergarten increases 
children's self-esteem. However, a fair portion of the test emphasizes com- 
fort in social situations, which is presumably improved by the first school 
experience. Kindergarten attendance bore no relation to amount of change 
in self-esteem; thus it appears that if there is an influence, it may be 
rather quickly overridden. 

Effect O f Tutoring on Self-Esteem 

Figure 10 compares the development of self-esteem as indicated by pre- 
and post-tutoring test results for tutored and control group children. The 
results are comparable to those for reading, except that there was no sig- 
nificant margin between the two groups. For the project as a whole, both 
groups of children gained in self-esteem. The mean gain for tutored children 
was about 7 points versus about 5-1/2 points for the control group. Thus, 
there was a tendency to reverse the slight initial edge of the control group 
(a tendency contributed by the St. Louis project, as will be discussed shortly). 
The gains were sufficient to bring the means from the borderline category into 
the average category, albeit at the low end of the average range. 

As for the individual projects, Oxford and Denver wf re very close to 
the overall pattern, although the Denver centre^, group averaged very slightly 
greater p^a^n (the Oxford tutored group, on the other hand, augmented its 
slight initial lead). These differences are negligible. The St. Louis pattern, 
however, is significant, particularly in relation to the reading test results. 
Once again the control group made minimal progress: mean change in score of 
1.9 points with a standard deviation of 11.6). The tutore'^ group gained 7.1 
points with a standard deviation of 18.3. The difference could in part be 
due to a regression effect, since the control group started \/ith a mean in the 
average ranpe while the tutored group mean was '^borderline.'* However, such an 
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effect was not evident in Denver. There, the tutored Ri^oup started "border - 
line" and made '!coD gain than the control group, which started average* 

Effect of Other Study Variables on Change In Self -Esteem 

Children who tested higher initially In basic experiences (a proxy for 
family background at this age level) showed some tendency toward more progress 
in development of self-esteem, Ho\>fever, only about 5% associated variation 
was found between the two variables. All of the other variables considered 
in relation to reading were considered as well in relationship to self-esteem 
and none, including amount of tutoring and special services outside Upswing, 
showed any relationship to development of self-esteem. 

The teacher and tutor ratings of children's self-esteem at the end of 
the school year tended to be in line with the final self-esteem test results > 
which lends credence to their validity. The correspond'^nee was by no means 
perfect; low but significant correlations were obtained between the test out- 
come and both the teacher assessment (r = 0.24, a == .001) and the tutor 
assessment (r = 0.21, a == .05). 

Initial Level of Visual -Motor Integration Skill 

The tutored and untutored children were virtually identical in initial 
level of visual-motor integration skill as measured by the Beery-Buktenica test* 
The pretest means (raw score) were 8.7 tutored and 8.9 control, with standard 
deviations of 2.4 and 2.3, respectively. These statistics indicate a low level 
of V>tT skill for the children's age range. A raw score of 9 on the VMI converts 
to a chronological age equivalent of 5 years 3 months for both males and fe- 
males/^ The range of VMI raw scores was from 1 (a^e equivalent 2 years, 10 
months male and female) to 14 (age equivalent fi years, 10 months male, and 6 
years, 7 months female) . The Upswing children all (except one) were at least 
6 years old at the time of the pretest, and 63% were over 6-1/2 years old. 
Thus there was a strong tendency for these children to show delayed development 
of visual-motor integration. 

At some points along the raw score continuum, the con'/ersion yields a 
slightly different age equivalent for boys and pirls. The practice of 
dlsre^^ardinr, sex in the. Upswing analysis is justified by the even mix 
of girls and boys in the tutored and control groups.. 
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Of all the independent variables considered in this study, only basic 
experiences /family background had clearly any discernible relationship to 
initial VMI score. (The VMI data were not compared for different age groups, 
since that influence is known. The Upswing age range is quite limited, and 
the comparison groups were similarly distributed on age.) There was about 
just under 20% associated variation between initial VMI and initial TOBE 
scores. This finding could well be due to a cultural differential in child 
rearing practices. Recent inquiry in this area has pointed out the importance 
of nutrition and early exercise on development of VMI.^ 

Effect of Tutoring on Visual-Motor Integration 

Tutoring once again had no impact on development of skills in the 
criterion area. Both groups of Upswing children gained, but only marginally. 
At the end of the school year the tutored children's mean VMI test score was 
10.6, with a standard deviation of 2.6; the control group mean was 11.1, with 
a standard deviation of 2.1. These means translate into an age equivalent of 
about 6 years for males and 5 years, 10 months for females. The children 
still were from 6 months to 18 months below expectancy in visual-motor inte- 
gration, although the difference between the pre- and post-test means represents 
about 9 months' growth in about 6 months. This is an improvement ov«r the 
first year and suggests the groups were beginning to move toward expected 
level. If the effect were continuous, we might expect the children to catch 
up to peers in two or three years. 

The amount (nuniber of hours) of tutoring a child received apparently 
was unrelated to development of visual-motor skills over the year. It ±3 
possible, even probable, that most of the VMI improvement is attributable to 
a natural process of late maturing. The test scores merely reflect a popula- 
tion average, while many Upswing children appear to be ''late bloomers." Further, 
it appears that there were minimal if any benefits from emphasis on visual- 



See Herbert G. Birch and Joan D. Gussow, Disadvantaged Children: Health 
^JutHtion and 3ohool Failure. New York: Harcourt, Brace and World, 1970. 
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motor activities in tutoring. Ninety tutors said on the final questionnaire 
that they and their pupils had ''frequently" worked on activities to build 
visual-motor integration. Five said they ''rarely" did so and 27 said they 
"sometimes" did so. If we assume that children who were worked with frequently 
had more obvious problems than children who were never or rarely worked with, 
we might expect, due to regression effects and treatment effects, that the 
"frequent" group would make significantly greater gains. Figure 11 compares 
the amount of change in Vt\l test score for the "frequently" and ''rarely/ 
sometimes" groups. The former group showed greater dispersion of change in 
score, which could indicate both greater problems among children who frequently 
worked on \J}\1 skills in tutoring and some benefits of this "treatment." How- 
ever, the differences in the two distributions are marginal and could be 
attributable to influences other than tutoring activity. The authors of the 
VMI test define the domain of such problems and suggest general forms of cor-- 
rective activity. Although the Upswing tutors did not follow the test manual 
in working on VMI, observation indicates they covered much the same ground. 
Visual-motor problems and corrective exercises were given substantial attention 
in Upswing training sessions. The activities used in tutoring included color- 
ing, cutting, tracing, putting puzzles together, tactile and kinesthetic games, 
writing and activities related to development of writing skills, etc. 

The two years of Upswing indicate that visual-^mctor integration problems 
are difficult to resolve and are unlikely to be resolved by the efforts of 
volunteer tutors. However, if one can assume that remedial reading and atten- 
dance at a diagnostic learning center would involve work on visual-motor 
integration for children with problems in that category, then 75 Upswing children 
worked on V>!I with sometone besides their tutor or teacher. About two-thirds 
of the children who received professional special services received one of 
those two kinds. Yet special services also had no impact on development of 
VMI skills. 

The Upswing data also indicate that VMI problems did not Impact 
children's self-esteem or hinder their development of reading skills. Beery 
obtained correlations between VMI and reading test results on the order of 
0.4 to 0.5 for children from both low and mid- level socioeconomic backgrounds. 
However, the reading test used was from the Metropolitan Series. The 
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upswing analysis found this measure to be ineffective for Upswing-type 
children; when problems are present, the scoring system on the Metro- 
politan caused such error variance that the scores were more indicative of 
VMI than reading. Thus we feel Beery 's correlations may have been spuriously 
high. 

Effects of Tutoring on the Measure of Basic Experiences 

The Test of Basic Experiences proved to be an interesting measure that 
had more in common with all three of the criterion measures used in the eval- 
uation than they had with each other. These relationships will be explored 
shortly as the final element of the analysis of tutoring effects. Before we 
turn to that, however, the TOBE results deserve attention in their own right. 

It was stated in the description of children involved in this analysis 
that the TOBE was adopted as a proxy measure of family background character- 
istics relevant to school achievement. The pretutoring TOBE scores of the 
Upswing comparison groups were similar and the test results reflected (relative 
to the test's normative population) a paucity of environmental elements con- 
ducive to high performance in school. 

Figure 12 presents the pre- and post-tutoring basic statistics. Both 
groups of Upswing children made meaningful gains on the TOBE; the control 
group mean score went up about 1 point more than that of the tutored group, 
but this difference in amount of change was not significant. The differences 
between the two groups' final scores however, were statistically significant. 
The slightly greater gains made by the control group had an impact when added 
to their initial lead. This statistical distinction is less important than 
the fact that both groups improved. Percentile ranks give an indicator of 
the kind of progress toward the norm that children made. The final mean raw 
score of the control group fell at about the 30th percentile; the final mean 
score for the tutored children fell at about the 22nd percentile. The initial 
means were at the 8th and 7th percentiles, respectively. 

This outcome was surprising since the TOBE documentation indicates 
improved scores are not anticipated without test-specific instruction. One 
might suppose that the tutoring relationship is particularly conducive to 
expanding a child *s experience base; indeed, the goal was encouraged in all 
tutor training. Yet amount of tutoring had no relationship to change in 

105 

ERiC ^ 



BEST COPY AVAIUBLE 




CO 



CM 



Q 



is 



2tj 



o -a 



ERIC 



UJ 8 
CD in 



106 

118 



BEST COPY AVAILABLE 

TOBE score; moreover, the gains of the untutored children remain to be 
explained. The authors of the test found no impact of school itself on 
change in score. Further, if school itself made the difference, one would 
expect kindergarten to make a difference in initial TOBE scores; it did not. 
It is true that teachers as well as tutors were given an opportunity to look 
at the tests used in Upswing and were given the results of the pretutoring 
battery. However, no instructional program was worked out based on TOBE 
data unless individuals did so on their own. 

We have posited that the influence of the project resulted in a 
different kind of teaching that caused control group children to gain as much 
as tutored. The evidence for this is not so clear in the TOBE data as in the 
reading and self-esteem data. A difference in project presence, and there- 
fore in project impact on teachers in St. Louis, was proposed to explain the 
lack of gain among control group children's tested reading and self-esteem. 
However, St. Louis children gained about the same on the TOBE as did the 
tutored (in fact the control group gain was a fraction greater). Thus, the 
TOBE results remain somewhat enigmatic. 

Relationships Between Criterion Measures 

^ ^ ^ 

There were low but significant correlations between all pairs of 
criterion measures before tutoring. The TOBE showed the strongest relation- 
ship to other measures initially. There was about 20% associated variation 
between the initial TOBE and both initial reading and visual-motor integra- 
tion scores, and about 10% associated variation between the initial TOBE and 
self-esteem scores. All sets of starting scores tended to be on the low 
side in reference to normative data, although they were not as low as might 
have been anticipated except for the V>tl and, particularly, the TOBE. 

When the effect of initial score on amount of change in self-esteem 
and visual-motor integration skill was controlled, there appeared to be a 
positive relationship between the amount of progress children made in develop- 
ment of those skills over the year and the basic experiences (as measured 
by TOBE) children brought to the program. However, the associated variation 
observed was minis cule (4%-5%) . 

The characteristics measured in Upswing seemed to develop independently 
of each other. The only areas in which amounts of change showed any associations 
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were reading and basic experiences. Here again the relationship appeared to 
be tenuous. We obtained a correlation coefficient oi 0 1; although It tested 
as statistically significant > the value Is too low to be Important, 

In light of the weak albeit statistically significant associations 
between the Initial test results (while scores on all tended to be low) , and 
In light of the lack of association between tests In terms of gains. It can 
only be concluded that reading, self-esteem, and visual-motor Integration 
are discrete areas of development for children like those In Project Upswing, 
It also appears that, although the basic experience factor, or family back- 
ground, bears on level of functioning In all of these areas before formal 
schooling, the influence of background does not necessarily determine who 
makes the most progress in development of reading skills or self-esteem. 
Nor do basic experiences or background factors seem to be primary In visual^ 
motor problems or their resolution* 

The Upswing experience suggests that Improvements In the areas studied 
have to be valued Individually, for their own sake If they are to be valued at 
all, just as does kindergarten attende^ce. For Upswing-age children, there Is 
no reason to assume from these data that any of the criterion attributes Is a 
key to development of any of the others. 

CONCLUSIONS ABOUT THE EFFECTS OF UPSWING ON CHILDREN IN THE SECOND YEAR 

The analysis found clearer evidence of more substantial progress made 
by children in the second year of Upswing than in the first. However » children's 
progress in the second year was not attributable necessarily to tutoring itself* 
Both the tutored and untutored groups of children develop significantly in read- 
Ingy self-esteem and basic experiences. There was an indication of growth in 
both groups in visual-motor Integration skills— an area in which there was 
virtually no progress in the first year. 

It is clear that Upswing had impact in its second year, but iCwas 
Impact due to the presence of the Upswing program, not just tutoring. Upswing 
seems to have altered the school environment in a way that benefitted children. 
The evidence for this Is as follows. 

During the first vear. the project had a low profile In the schools. 
Teachers were offered only brief orientation, which many did not attend. They 
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expressed confusion about the goals and organization of the project. There 
were no Upswing liaison personnel working regularly In the schools except in 
San Francisco 9 where the liaison activity was concentrated in one school. In 
short, the project lacked presence . Further, teachers were given only broad 
guidelines for selecting children (average 10, with minimal learning difficulties 
was the stated combination of selection factors) , and generally did not know 
which children were in the Upswing control group. (Although they knew which 
children were assigned tutors, the teachers apparently did not necessarily 
connnect "no tutor" with control group status. The test factor may have been 
confusing because testing in the first year was intended to be a screening 
device.) 

In the second year, teachers were given training in child observation 
and were given a set of behavioral descriptors to use, as a guideline in making 
selections. Regardless of the quality of the training or the appropriateness 
of the behavioral guideline, they served on function: to focus teachers atten-* 
tion on the characteristics and needs of certain individual children. In 
addition, teachers were explicitly told which of their pupils were in the 
Upswing control group; in two of the four cities they received Upswing training 
throughout the year; and in all cities, an Upswing staff member visited each 
school at least once a week. 

As the foregoing suggests, the conclusion is that control group gains 
in the second year are attributable to teacher efforts with those children. 
The greater or different kind of teacher work with Upswing control children in 
turn appears to be attributable to increased teacher awareness of involvement 
in a national-scale pilot project, to increased attention to teacher needs and 
preferences by Upswing staff, and to the training offered teachers by the 
project. Teachers did not always value Upswing training; however its possible 
Import is reflected in the fact chat 60% of the teachers said they had no train- 
ing in child development outside of Project Upswing. 

The data show that the St» Louis control group made very minimal progress 
in the second year as in the first, while tutored children made significant gains 
both years (although greater gains in the second) . It appears that this can be 
traced to project characteristics • There was no teacher training program in 
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St. Louis. Teachers were given project orientation individually^ which included 
discussion of the child characteristics relevant to selection of children for 
Upswing and use of the behavior inventory as a selection aid. In the schools, 
Upswing staff apparently focused their efforts on providing assistance to tutors, 
although staff maintained friendly relationships with teachers and checked on 
their satisfaction with the tutors. St. Louis teachers generally were quite 
satisfied with Upswing, but it seems that they were not involved in the same 
way as teachers in other cities. It also seems that the project's identity 
was different from and not so strong as it was in other locations. 
It is possible that teachers: 

• Intentionally compensated to control group 
children 

• Were made to feel special, and specially-obser>;ed 
by involvement in Upswing and therefore performed 
better"^ 

• Benefitted professionally by their involvement 
through increased awareness of the need for and 
methods of child observation and prescriptive 
instruction 

• Began to believe more in the children's capacity 
to improve because the teachers made a conscious 
decision that each child had potential for normal 
functioning in the classroom.^ 

More than likely all of these explanations were operative. 

As for the children, tutored and untutored alike, we still do not know 
whether the progress they made is attributable to the simple fact that they 
were given special attention or to instruction. Both vrere no doubt involved, 
but in what proportions we do not luicw* Number of hours of tutoring a child 



Something like the classic Hawthorne effect: F.J. Roethlisberger and 
W.J. Dickson, 1970. Managenent and the Worker. Cambridge, Massachusetts: 
Harvard University Press- 

R. Rosenthal and L. Jacob son, 1968. Pyomlion In the Ctassroon. New 
York: Hold, Rhinehard, & Winston. 

no 



ERIC 



122 



BEST COPY WAIIABLE 

received was positively associated with test-observed reading gains (there 
seemed to be a minimum number of hours required for significant gain). This 
suggests instruction could have been more important in development of reading 
skills. However, number of hours of tutoring apparently had nothing to do 
with gains In self-esteem, visual-* lotor skills, or basic evneriences. This 
suG;gest'; that attention, with a strong classroom factor, could have been 
tlie more Important variable in tliese areas. 

The foregoing may seem to suggest that the work of the tutors was of 
little or no importance. That is not our intent. Tutoring itself had sig- 
nificant Impact in the first year and there is no reason to believe it did 
not in the second. It is just that the untutored children got a share of 
Upswing benefits from another source, and tutored children as veil may have 
received benefits of Involvement from sourcws outside the tutoring relation- 
ship • 

One additional piece of evidence for project impact in the second year 
comes from the follow-up data. In the year following Upswing involvement, 
neither the former tutored group nor the former control group increased its 
rate of pi"ogress in reading; in fact, there was a suggestion of a possible 
decline in skills for both groups. This was true even for children who 
received remedial reading in the follow-up year. 
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V. UPSWING TRAINING AND PROJECT MANAGEMENT 



The analysis identified two essential attributes of a successful 
in-school volunteer program: 

• Active leadership in the schools 

• Continuing personal interaction between 
the leadership and the participant groups. 

The meaning of these two sunnuary statements is developed in this section. 
It may be said at the outset that the important characteristics of this 
project appear closely related to the sense of involvement of various 
participant groups and to the way individuals perceive the importance 
of project objectives and/or activities . The following presentation 
describes management and training strategies used in Upswing. It re- 
lates the evidence to our belief that Upswing was "successful.*' 

WHAT WAS LEARNED IN THE FIRST YEAR OF UPSWING^ 

The original design involved project leadership most heavily at 
the beginning and end of tutoring. The tutoring period itself was a 



^ Operations in the first year were described in detail in two previous 
reports: P. Plantec, et at; Evaluation of Pro.jeot Upswing: Interim 
Retcvt (January 1972), and Final Evaluation of Project Upswing^ s First 
'{en'^ (December 1972). Silver Spring, Maryland: Operations Research, 
Inc., Technical Reports 700 and 731. 
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kind of grey area in which needs for management apparently were not thought 
out fully. It appears that the assumption was something like: once you 
get the nachine running it will cake care of itself; you only have to come 
back in to shut it off. 

To get the projects started, the directors: 

• Explained Upswing to school system administrators 
and got their agreement to receive the project in 
the schools 

• Contacted school principals for their agreement 
to participate and to recruit teachers (teachers 
were recruited by principals and, in some cases, 
participated unwillingly) 

6 Recruited volunteers to serve as tutors, through 
newspapers, television and radio, through local 
school volunteer organizations, churches, and 
clubs, and through the universities 

• Bought tutoring materials 

• Conducted approximately 15 hours of prescribed 
preservice training for the volunteer tutors 

• Held a two-hour orientation meeting for some 
teachers who agreed to participate 

• Asked teachers to refer children who appeared 
to need extra help 

• Divided the children referred into experimental 
and control groups and assigned volunteers to 
ch1 Idren 

• Tested children. 

Most of the foregoing activities took place in the summer before 
school opened or immediately after school started. Volunteer recruitment, 
hov/ever, as well as selection and assignment of children, continued through 
October. Tutoring began in November. Many tutors recruited early lost 
interest by the time actual tutoring started, and dropped out. 

Delays were encountered in another major start-up task — preterting 
of children. Test results were intended to be used for making final selections 
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from among referrals and for ensuring matched groups for the evaluation. 
However, tutoring had to get under way before testing could be finished 
and the results reviewed. "Pretesting" went on from October into January. 

The only other prescribed activity of project staff was to administer 
the Lest battery at the end of tutoring. This was done in April and May. 

Managenient Problems 

The directors \rd staff typically found themselves involved in con- 
trolling minor crises from the beginning of tutoring. There was apparently 
a lack of role definition. School personnel seemed unsure of their respon- 
sibilities to Upswing tutors, and there was limited opportunity for teachers 
and principals to communicate with tutors. Although there were exceptions, 
most teachers and tutors had great difficulty arranging to meet and discuss 
the child being tutored. In some cases there was little motivation on 
either the teacher's or volunteer's part to discuss the child. 

Upswing staff were not often present in the schools. Conflict 
and even hard feelings arose in a number of cases because of poor communi- 
cation and a lack of clear leadership for Upswing activities at the school 
building level. Unbeknownst to project staff, there was considerable tutor 
absenteeism and attrition; this seemed to be the problem that bothered 
Gchool personnel the most. The tutors often felt they were not getting 
the advice and encouragement they needed to do a good job; questionnaires 
indicated that tutors felt somewhat isolated. 

From talking with teachers and principals, it appears that such 
problems are common in school volunteer programs. Supervision and support 
of volunteers In the schools seem to be critical needs that are difficult, 
if not impossible, for regular school personnel to satisfy in view of their 
other responsibilities. 

Problems in Training 

Tutors indicated that preservice training did not fully meet the 
needs they felt in working with their pupils. Typical comments were that 
the preservice training was good, but covered too much to absorb in so 
short a time period, was too general, and too abstract. 
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Many tutors called the project office for help» In one city, the 
untrained tutors felt especially at a loss, and the project director 
responded by conferring individually with all who wanted help, to diagnose 
children's problems and work out prescriptive tutoring plans. Although 
it IS undocumented, ORI detected in field visits that a significant amount 
of individual prescriptive advice was given tutors informally by project 
staff. However, it appears that such advice was given to the relatively 
few individuals who actively sought it out. 

There were a few inservice meetings held for the trained group. 
Tutors generally were reluctant to call them "inadequate," but noted on 
questionnaires that these meetings occurred too late in the year and did 
not meet individual needs. 

Communications 

The projects generally responded to problems as soon as they learned 
of them, but since channels of communication during tutoring were poorly 
defined, it often was rather late before needs were brought to staff members^ 
attention. TTenerally the initiative had to be taken by the individual tutor, 
by the teacher, or by a principal acting for a teacher. Teachers particularly 
tended to keep their problems with Upswing to themselves, probably because 
they were too busy with other activities which were regarded as more important 
or more directly their responsibility. In personal interviews with a sample 
of participants, the evaluation team found a good many dissatisfactions with 
Upsswing that had not been expressed. The team also found widespread appre- 
ciation and a general high regard for the project despite the problems. 

The foregoing review of Upswing's first year focused on problems. 
We do not want co imply that problems were paramount. The large majority 
of participants in Upswing found it satisfying and worthwhile. The most 
uncertainty was found among teachers. Our purpose in pointing out the 
problems i'5 to show why the projects took the direction they did in the 
second year. 

NEW EMPHASES IN THE SECOND YEAR 

The evaluation indicates that the most important changes mad^ in 
Upswing's second year may be summed up as increased interaction between 
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Upswing staff and all groups of participants, and clearer definition of the 
roles of staff and participants • These changes were accomplished in some- 
what different ways by different projects, but the analysis indicates that, 
with the exception of St. Louis, the differences in approach were small, St. 
Louis, which did not have any formal inservice training, will be discussed 
a little farther on in the narrative. 

ORIENTATION AND TRAINING FOR TUTORS 

The U.S. Office of Education specified that a minimum of 30 hours 
of tutor training should be given. The allocation of time to preservice 
and inservice training was left to the discretion of the project directors, 
as were the format of training and the content beyond certain minimum require- 
ments . 

Preservice Training 

All projects tried to equip tutors with enough background informa- 
tion to give them confidence in st£.r..ing to work with their pupils. There 
were different views of what constituted enough, as shown by the number 
of hours allocated to presexrvice training. However, based on responses to 
a questionnaire distributed about two months after tutoring began, tutors 
generally tended to be satisfied with the amounts of preliminary informa- 
tion received. 

A set of minimum requirements for preservice training was established 
by the U.S. Office of Education and the project directors. Those require- 
ments were: 

• To describe Project Upswing's organization and 
objectives, including definition of roles and 
relationships of project participants 

• To provide orientation information about the 
schools and the first-grade curriculum 

• To define the rules of conduct and dress Upswing 
tutors would be expected to follow in the schools. 

In addition, the preservice training offered by all projects included: 

• Discussion of normal developmental needs and 
characteristics of Upswing-age children 
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• Discussion of special characteristics and needs 

of children who have minimal learning difficulties. 
Evaluation team observations, backed up by questionnaire responses of the 
tutors, indicated that the depth and quality, or both, of coverage of these 
aspects of child development varied; however, all projects at least touched 
upon them. 

Another common feature was that all projects used the readiness 
inventories completed by teachers in selecting children for Upswing. Each 
tutor was given the inventory, and in some cases the pretest data of his or 
her pupil as well. Staff helped tutors interpret the information for diag- 
nosis and planning of a prescriptive approach to tutoring. This was not 
always done in preservice training, but if not, it was done individually, 
shortly after tutoring began. 

All projects paid careful attention to housekeeping details in the 
second year, since they had been troublespots in the first. The staff made 
sure in preservice training to tell tutors how to get to their school, the 
school telephone number and secretary's name, the name of their pupil's 
teacher, the procedure to use to report in at the school, the procedure 
to use if they could not keep a tutoring appointment, and the name and 
telephone number of an Upswing staff member to contact about questions or 
problems . 

Tutor Opinion About Preservice Training 

Table 23 summarizes tutor opinion about the adequacy of training in 
defining the project and participants' roles, and in equipping them to start 
working with the children. The data are from the "Volunteer Registration 
and First Impressions" questionnaire, distributed about two months after 
tutoring began (copy in Appendix B) . The response rates were as follows: 



city 


No. of Tutors in Project 
When 

Form V/as Distributed 


No . of Tutors 
Who Returned Form 


Response Rate 


Denver 


42 


36 


85% 


Oxford 


53 


49 


92% 


St. Louis 


45 


35 


78% 


Son Francisco 


34 


25 


74% 
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Table 23 Indicates that all projects did quite well in clarifying 
project goals and the roles of tutors, teachers, and Upswing staff. There 
appear to have been some minor differences in effectiveness in establishing 
teacher and staff roles in the minds of tutors, but the differences are 
relatively unimportant in view of the overall picture of success. 

Differences were greater in tutor satisfaction with child- related 
information. It is evident that the Denver project^s comparatively extensive 
and very well-planned preservice training program resulted in greater tutor 
satisfaction. Denver offered 24 hours of training before tutoring began; 
the agenda included observation of prospective pupils in the classroom 
followed by discussion. The other cities offered 6 hours (San Francisco), 
8 hours (Oxford), and 15 hours (St. Louis). 

The weakest aspect of preservice training in all cities was how to 
recognize and deal with different kinds of learning problems. That is also, 
of course, the most complex and difficult to convey of all the topics 
addressed in the training. 

Table 24 shows that the projects all were quite successful in cover- 
ing organizational matters for a smooth beginning of tutoring. The weakest 
areas in all cases were preliminary arrangement for tutoring space and 
adequacy of tutoring space. Oxford was exceptionally successful in getting 
arrangements made in advance. Tutoring locations had to be left up to 
school staff, and in many cases there was not much they could do because 
there were few options and much competition for space outside classrooms. 
Apparently San Francisco schools were most accommodating or San Francisco 
tutors were most tolerant of less than optimal tutoring locations. How 
ever, tut r comments indicated that in all cities they understood the problems 
of setting aside space for tutoring. 

Denver and Oxford tutors apparently were less well informed about 
what tutoring materials were available to them in the schools. The St. 
Louis project distributed a typed list of mater:.als to tutors and set up 
a supply closet in each school which was 100% effective in that area. 
Despite the foregoing differences, the major conclusion is that organiza- 
tional matters were handled well in all cities. 
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Assessments of preservice training should be considered in rela- 
tion to the overall assessments of training and to the findings about 
project effects on children. The initial response to training will be 
considered in those contexts as the analysis develops, 

Inservice Training for Tutors 

The following topics were required to be covered in inservice 
training if they were not covered in preservice training: 

• Orientation to first-grade children (normal 
developmental characteristics and needs) 

• Orientation to characteristics and needs of 
children with minimal learning difficulties 

• Techniques for developing and maintaining 
relationship with child, teacher 

• Use of Peabody Language Development Kit^ 

• Techniques for supporting child's classroom 
learning activities (how to use actual class- 
room materials and related materials) 

• How to organize and pace tutoring sessions 

• Techniques of positive reinforcement. 

Beyond these requirements, the projects were free to provide any additional 
training, reinforcement of previous training, or problem-solving assistance 
they thought appropriate, with the condition that such additional assistance 
had to be given over the tutoring period, whether individually or in a group 
workshop type mode. 

Three of the four projects established a schedule of regular meetings 
for tutors throughout the year. The meetings were held monthly in Denver 
and San Francisco. They were held weekly in Oxford, since Project Upswing 
constituted a course at the University of Mississippi. Although inservice 



The Peabody Kit is a commercially developed package that includes picture 
cards, puppets, interlocking colored links, etc., designed to stimulate 
a child's thinking and verbalization. A set of lesson plans is provided 
with the kit, but most Upswing tutors preferred to ad lib, using the 
Peabody for a change of pace along with other tutoring activities. 
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meetings were not attended regularly by all tutors » they built a reliable 

conraiuni cations channel into the pro j acts • The data indicate that they 

were> on the whole, responsive to tutors' needs and strengthened the projects. 

There was no inservice training program for tutors in the St* Louis 
project. The approach to ongoing support there was entirely individualized* 
Staff members visited the elementary schools twice weekly and helped indi- 
vidual tutors as needed. There were one or two get-togethers for the tutors 
in some schools, in which they shared ideas, tribulations, and successes; 
staff were there for consultation at those times. The other projects also 
had staff members visiting each school at least once a week. Thus there was 
double coverage in the other cities. 

Tutor Opinion About the Overall Training Program 

By the end of the year, opinion about training appeared to be 
somewhat less enthusiastic overall than at the beginning* Nevertheless, 
the tutors indicated that they generally considered training necessary 
and that they valued the training they received. Questionnaire comments 
indicated a good deal more satisfaction (or less dissatisfaction) with the 
training in the second year than in the first. In the following presenta- 
tion, two training modes are considered separately — group sessions, which 
were more in line with the standard implications of "training " and individual 
counseling. 

The following data were taken from the "Volunteer Final Impressions" 
questionnaire (copy in Appendix B) , which was distributed in May 1973. The 
response rates were: 



City 


No. of Tutors in Project 
When 

Form Was Distributed 


No. of Tutors 
Who Returned Form 


Response Rate 


Denver 


37 


31 


84% 


Oxford 


47 


43 


91% 


St. Louis 


42 


30 


71% 


San Francisco 


20 


16 


80% 
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The rationale for collecting tutors' final impressions of the adequacy 
of ti ining is that the experience gives perspective to the original impres- 
sions. It was expected that some f irst-impressioi optimism would be dampened 
by the reality of facing the tutoring challenge, a;d such was the case. A 
full understanding of the general final impressions of training and the reasons 
behind them can only be obtained through some detailed analysis. So, proceed- 
ing from the general to the specific, we present the findings below. 

'Jeneral Value of Group Tminim Sesaiona . In the final analysis, half 
of the Upswing tutors still felt that the training sessions were very important 
to them, perhaps not perfect, but essential to performance. Another 29% agreed 
that the group training was quite useful, but felt that it was not essential 
to the task. Bear in mind that both views probably were correct. Upswing's 
first year proved that some people do not really need much training, while 
others do. No one said that training was completely unnecessary, only one 
said that it was presented poorly, and only three said they needed no train- 
ing. 

Table 25 gives a breakdown of responses about the value of group train- 
ing from each city and for all cities combined. The percentage of responses 
of each kind are given, but should be compared city to city only with 
caution; the number of respondents in each city, especially San Francisco, 
is so small a base, that percentages may be misleading. The most important 
point to be made about these data for each city are those just made about 
the overall responses. About 60% of respondents in all cities except St. 
Louis felt that the group training meetings were very important to their 
work as tutors. The difference in St. Louis is evidently related to the 
number, timing, and nature of meetings held there, as described previously; 
it does not necessarily mean that St. Louis tutors valued the training they 
received less, only that, apparently they found less of substance in the few 
.7ro-.<r meetings that were held. The fewest "useful but not essential" 
responses came from Denver (fewest in relation to number of respondents), 
which could indicate proportionally greater value placed on training meetings 
there. However, the picture is obscured by comparatively high self-reported 
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TABLE 25 

TUTOR OPINION ABOUT THE GENERAL VALUE OF UPSWING 
GROUP TRAINING MEETINGS 

(Percentages based on number of respondents in each city who 
answered question. Only one, in Denver, did not.) 





Number and Percentage of Respondents 






Who Expressed Each Opinion 




Tn tr>r Onininn 


Denver 


Oxford 


St. Louis 


San Francisco 




Did not attend enough 


7 


2 

5% 


10 

33% 


1 


20 
17% 


meetings to have an 
opinion 


23% 


7% 


I did not need 


2 


0 


1 


0 


3 


training 


6% 




3% 




3% 


Training is not 


0 


0 


0 


0 


0 


necessary for tutors 












Training was generally 


0 


0 


1 


0 


1 


presented poorly 






3% 




1% 


Training was useful but 


3 


16 


11 


5 


35 


not essential 


10% 


37% 


37% 


33% 


29% 


Training was very 
important to me as a 
tutor 


19 
61% 


25 
58% 


7 

24% 


9 

60% 


60 
50% 


Toldl 


31 


43 


30 


15 


119 




100% 


100% 


100% 


100% 


100% 
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absenteeism in Denver. (One cannot tell if the ''I did not attend 
responses in St. Louis are truly absence-related or are related to the 
number of meetings held.) The San Francisco training program was quite 
similar to Denver'^ in content and approach, but the San Francisco project 
had a much lower staff -tutor ratio, and the staff gave more individualized 
assistance to tutors than was given in Denver. It appears likely that group 
meetings were considered less essential by San Francisco tutors because they 
had such strong support outside the meetings. 

In Oxford, as noted previously, Upswing meetings, held weekly, con- 
stituted a university course. Because of this frequency, non-student 
volunteers did not always attend, and they may have perceived the meetings 
as not designed for them. The university students involved in Upswing were 
almost all upper-level students in the School of Education. They had gen- 
erally taken and currently were ta;-.Ing other courses relevant to tutoring, 
so that the Upswing sessions may well have been somewhat less significant 
to them than to tutors not immersed in education. 

To Investigate the general impressions of group training, tutors were 
asked a number of questions about . specif ic characteristics of meetings. 

Content of Group Meetings. The aspect that contributed most to satis- 
faction of the trainees was the introduction of new ideas for use In tutoring, 
ideas about specific materials and techniques. Other factors contributing 
significantly to the utility of training as perceived by the trainees were 
(in order of importance): how to size up the child, his needs and what to 
expect; the confidence which comes from being trained; how to relate to the 
child and teacher; how to evaluate the child's progress; and how to handle 
behavior problems. A ranked list of important factors is provided in 
Table 26. 

Tutors were given an opportunity to suggest alternate types of group 
sessions. About 35% of the tutors used the opportunity to suggest what they 
felt would be improvements. Most of the suggestions for better training 
came from St. Louis where very little formal training was offered. It is 
interesting to note that the suggestions for alternate types of training 
(from all cities) correspond almost exactly with the reasons volunteers 
were most satisfied with training, which indicates both that these things 
were important and they they were not adequately presented, to varying 
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ASPECTS OF GROUP TRAINING COiCSIDERED MOST USEFUL BY TUTORS 



(Percentages based on a total of 98, the 
number of respondents to this question.) 



Major Reasons for Usefulness 
of Sessions 


Response 
Rates* 


They acquainted me with a variety of 
materials and their uses 


77% 


They gave me knowledge of teaching 
techniques 


60% 


They helped me tutor appropriately 
to meet my pupil's specific 
learning needs 


37% 


They helped me know what to expect 
from my pupil 


32% 


They helped me diagnose my pupil's 
speciiic iearning neeas 


o i /o 


They gave me confidence 


21% 


They helped me to have a better 
relationship with my pupil 


8% 


They helped me have a better 
relationship with my pupiTs 
teacher 


8% 


They helped me evaluate my pupil's 
progress 


6% 


They helped me handle behavior 
problems 


5% 


* Respondents checked the three reasons they considered 
most important. 
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degrees. It appears that more self-perceived needs were unmet in St. Louis 
where little formal training was offered. And all was offered before tutoring 
began. These perceived needs did not affect ability to tutor, according to 
the children's test results. 

The most frequent suggestions were, in order of importance: 

• Meetings to discuss tutoring ideas 

• Meetings for instruction in specialized techniques 
t Help in planning lessons to cover specific problems 

• Sessions to observe classroom teachers with first-- 
grade children 

• Meetings to discuss current school reading program 

• Meetings between volunteers and teachers to discuss 
role expectations. 

oahedule and Environmental Aspects of Training Meetings . The tutors 
were asked to assess the schedule, location, physical environment, and social 
atmosphere of Upswing meetings to make sure such variables did not impact their 
assessment of the value of training. No negative influence was found. About 
85%-10C% of the respondents in all locations said that these aspects of Upswing 
meetings were favorable. The only factor that tutors said caused them to miss 
meetings was schedule, and schedule conflicts did not appear to be a great 
prob lem. 

General Value of Individual Counselinci. Overall, about 75% of the 
responding tutors valued the individual help they received from Upswing staff. 
Forty-three percent considered it useful, although not essential, while 32% 
considered it very important (by implication, essential). These data were not 
cross tabulated with the data on the general value of group training. How- 
ever, the response patterns are about the same. 

The distribution of opinion about the value of individual help is 
presented in Table 27 for each city and for all combined. As for group train- 
ing, the percentage of responses in each category for the individual cities 
are based on too low numbers to be substantial. The most important features 
of the data are that the respondents in each city responded favorably about 
the worth of the help received. Only four respondents, dispersed over three 
cities, said that individual help was not available to them, while only seven 

128 



ERIC 



139 



BEST COPY AVAtUBLE 



S5 

LD 
I— 1 

00 



to 



LD 



CO 

\ 
00 
00 



S5 



S5 

CD 



CO 

\ 

(J) 



CO 

I— 1 



55 



O 

LD 
\ 
LD 



\ 

00 



CO 



1-1 



H Q 



1—1 

\ 



55 



S5 
\ 

CD 



S5 
to 

(NJ 



S5 

CD 
1—1 

to 



S5 



55 



S5 

CO 

\ 

o 



CO 

> 
C 

CD 
(D 

a 
o 

^ a 

T3 ^ 



« ^ > 

^ 



LD T3 



O 



^ CD 



+-* to 
o o 



-I f>. 



> 



o 



(0 



ERIC 



129 

140 



BEST COPY AVAILABLE 



respondents, from three cities, said the kinds of help offered did not meet 
their needs. About 15% said that they did not need individual help. 

A greater proportion of respondents in San Francisco than in any other 
city considered individual help very important. We relate this to the very 
low tutor-staff ratio. San Francisco had trouble recruiting volunteers and 
about half of those who started tutoring dropped out. The respondents from 
that city probably represent a core group of tutors who were very dedicated 
to the project and who received a great deal of high-quality individual 
attention. Interestingly, St. Louis tutors placed no more value on individual 
help than on the group training offered there. 

Content of Individual Covnseling. The tutors were asked to indicate 
the ways in which individual help was useful to them if they had found it 
useful (Table 28). They were given the same checklist of benefits as shown 
in Table 26 for training meetings. The dispersion of responses in Table 28 
reflects the obvious — individual help was useful to different people for 
different reasons. Comparison of Tables 26 and 28 shows that there was ex- 
tensive overlap in the benefits of tormal training and individual help as 
perceived by tutors. Formal training was valued most for what it was intended 
primarily to do — acquaint tutors with instructional materials and techniques. 
Individual help tended to be valued considerably less consistently for these 
reasons, valued somewhat more often than formal training for building tutor 
confidence, and considerably more often for helping with tutor expectancies 
for pupils, pupil evaluation, and the pupil-tutor relationship. 

When asked where Individual help could have been stronger » tutors 
named the following (listed in order of importance): 

• Inservlce hints or suggested approaches to 
dealing with the child (or school) [this seemed 
to refer to management of behavior or attitude 
problems with the child; the school factors 
were not clear] 

• Discussions with child's teacher about techniques 
and progress 

• Extra individual instruction In reading techniques* 
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TABLE 28 

ASPECTS OF INDIVIDUAL HELP FROM UPSWING STAFF 
CONSIDERED MOST USEFUL BY TUTORS 

(Percentages based on a total of 98, 
the number of respondents who 
answered the question.) 



Major Reasons for Usefulness 
of Individual Help 


Response 
Rate* 


It helped me tutor appropriately 
to meet my pupil's specific 
learning needs 




It gave me knowledge of 
teaching techniques 


34% 


It gave me confidence 


33% 


It helped me diagnose my 
pupil's specific learning 
needs 


29% 


It acquainted me with a 
variety of materials and 
their uses 


26% 


It helped me to know what to 
expect from my pupil 


26% 


It helped me to have a better 
relationship with my 
pupil 


21% 


It helped me evaluate my 
pupil's progiess 


20% 


It helped me handle behavior 
problems 


15% 


It helped me have a better 
relationship with my 
pupil's teacher 


11% 


*Respondents checked the three reasons 
they considered most important • 
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Ar^ount. Nearly 70% of the second-year tutors felt they had an adequate 
iirount of individual counseling. The other 30% expressed a need for additional 
help. About this ratio prevailed in all cities except San Francisco, which 
had the greatest proportion of tutors (12 out of 15) who expressed satisfaction 
with the amount of individual counseling received. Again this seems to be 
related to tutor-staff ratio. 

Groi4p Tminina Vevsus Individual Counseling . Volunteers were asked 
to compare the utility of group training and individual counseling. As shown 
in Table 29, nearly half the tutors preferred not to make a choice, seeing 
the two as equally useful. About a third preferred the group training to 
individual and the rest preferred individual counseling. It is important 
to note that in Denver, where group training was emphasized, about half of 
the tutors preferred that form of training; while in St. Louis, where individ- 
ual counseling was stressed, about half of the respondents stated they preferred 
it that way. This evidence supports the assumption that the specific training 
approach should be developed to suit the experience and strengths of the key 
training individuals, rather than to follow an externally prescribed course. 

From what happened in the first year, it appears that individual 
contact is necessary; but it does not have to be (and should not be, in view 
of costs), the primary mode of delivering training. Indeed, the individual 
contact in all locations involved mostly problem-solving, response to questions t 
and moral support rather than training. The data suggest that tutors tended to 
perceive training and individual counseling as coequal and separate functions, 
both useful, but not necessarily essential to their work. 

I'laterlalo Used in Trainjyig . Eighty-two percent of the tutors who 
responded to the questionnaire thought the materials used in the training they 
received were either good or outstanding. Only 15% of all respondents con- 
sidered the materials inappropriate or of little value. Table 30 lists types 
of materials used in training. 

The Peabody Language Development Kit was described previously. The 
DISTAR Reading System is a phonics-based program designed originally for 
children who have fairly serious reading problems. It is set up for group 
instruction, and some of the Upswing tutors found it difficult to adapt for 
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TABLE 29 

TUTORS' OPINION AS TO WHAT APPROACH WAS MOST USEFUL 

TO THEM IN TUTORING 



(Percentages based on number of respondents in each city who 
answered the question; one in St. Louis did not.) 



Preferred Training 
Approach 


Number and Percentage of Respondents Who 
Expressed Each Opinion 


Total 


Denver 


Oxford 


St. Louis 


San Francisco 


Group 


15/48% 


13/30% 


6/21% 


4/27% 


38/32% 


Individual 


5/16% 


10/23% 


14/48% 


3/20% 


32/27% 


Both 


10/32% 


20/47% 


9/31% 


8/53% 


47/40% 


Neither 


1/4% 


0 


0 


0 


1/1% 


Total 


31 

100% 


43 

100% 


29 
100% 


15 
100% 


118 
100% 
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TABLE 30 

TRAINING MATERIALS FOUND TO HAVE MOST VALUE 
BY UPSWING TUTORS 



Material 


Percentage of All Respondents 


Peabody 


28 


Games, puzzles 


15 


DISTAR 


14 


Fldsh cards 


9 


Arts and crafts 


9 


Library and other 
non-textbooks 


7 


Workbooks 


4 


Exercises 


3 


Tokens 


3 


Chalkboard 


3 


InstPicto 


3 


Tape recorder 


2 


Other 


2 


Total 


100% 
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one-to-one instruction* DISTAR depends on rythmic oral repicition to establish 
sounds and words in a child's memory. It is highly structured, and the pub- 
lishers stress that strict adherence to the program on a regular basis is essential. 
Generally DISTAR lessons are given daily rather than twice a week* Many Upswing 
tutors considered the program too rigid. The cost of these kits prohibited pur- 
chase of one for every tutor. One or two of each was kept in all Upswing schools. 
They could not be taken home by the tutors for preparation except by special 
arrangement. This was considered an impediment to using the materials, especially 
DISTAR, by many tutors. 

''instructo" is another commercially-developed kit used primarily in St. 
Louis (a few kits may have been purchased for use in Oxford). It includes 
picture cards, work cards, a flannel/chalk board combination, etc. Lesson 
plans (for group use) are provided, covering color recognition, development 
of sight vocabulary, initial sounds, etc. — the usual components of a beginning 
reading program. 

The other materials listed in Table 30 are self-explanatory. The table 
gives the percentage of respondents (from all projects combined) that considered 
each the most useful tutor-training material. It is clear from the dispersion 
of opinion in Table 30 that the specific materials used as a springboard for 
training are not critical. Variety seems to have been the key for reaching 
Upswing tutors* 

Attendance at Tutor Training Meetings 

Tables 31 and 32 show the rates of attendance at training meetings held 
before and during tutoring. Attendance was consistently better before tutoring. 
The reasons for variation beyond that are not clear. Oxford is a special case, 
since Upswing was a university course and the majority of tutors were university 
students for whom attendance was more or less compulsory. San Francisco had 
the best preservice attendance rate with the fewest number of sessions and hours. 
However, San Francisco also had a better inservice rate than Denver, with more 
sessions. San Francisco held three inservice meetings in October, two in 
November, one in December and January, two in February and March, and one in 
April, Denver held only one inservice meeting each month from December through 
May . 
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TABLE 31 

TUTOR ATTENDANCE AT PRESERVICE TRAINING MEETINGS 

(Percentage based on number of tutors reported by each 
project to be in tutor group at time training was offered.) 





Tutors in Each Attendance Category, by City 


Percentage of 
Training Tutor 
Attended 


Denver 
(total hours 
offered =22) 


Oxford 
(total hours 
offered = 8) 


St. Louis 
(total hours 
offered =15) 


San Francisco 
(total hours 
offered = 6) 


907o-1007o 


12/31% 


34/74% 


10/20% 


39/95% 


80% -8 9% 


8/20% 


9/20% 


0 


0 


70%-79% 


3/8% 


2/4% 


7/14% 


0 


60%-69% 


5/13% ■ 


0 


6/12% 


0 


50%-59% 


3/8% 


0 


0 


1/2% 


< 50% 


8/20% 


1/2% 


8/16% 


0 


0 


0 


0 


19/38% 


1/2% 


Total 


39 

100% 


46 
100% 


50 
100% 


41 

99%* 



* Rounding error. 
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TABLE 32 



TUTOR ATTENDANCE AT INSERVICE TRAINING MEETINGS 

(Tutors reported to have attrited before 
January 1, 1973, omitted.) 





Tutors in Each Attendance Category, by City 


Percentage of Training 
Tutor Attended 


Denver 
(total hours 
offered =10) 


Oxford 
(total hours 
offered = 22) 


San Francisco 
(total hours 
offered =39) 


90%-100% 


7/15% 


11/24% 


4/14% 


80%-89% 


4/8% 


17/38% 


4/14% 


70%-79% 


0 


7/16% 


3/10% 


60%-69% 


9/19% 


5/11% 


4/14% 


50%-59% 


0 


3/7% 


6/21% 


< 50% 


20/42% 


2/4% 


8/27% 


0 


8/17% 


0 


0 


Total 


48 
101%* 


45 
100% 


29 
100% 


* Rounding error. 
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The amount of preservice training offered in Denver, with rather good 
attendance (about 80% of the tutors took part in 60% or more) may have some- 
thing to do with the comparatively low attendance at the monthly inservice 
meetings. Denver had a better turnout for 22 hours of preservice training 
than St. Louis had for 15 hours. This may have occurred because the meetings 
in the former city were spread over a 4-6 week T)eriod in the fall, while they 
were concentrated into four 3-hour sessions in one week during the late summer 
in St. Louis, with a final 3-hour meeting on a Saturday morning shortly 
after school started. This is interesting since teachers seemed to give 
better attendance where meetings were concentrated rather than shorter and 
held over a longer time period. 

On the whole, attendance at training was not very good (except In 
Oxford, as explained previously). It certainly casts doubt on the value of 
investing time in development of an extensive training program even without 
the earlier finding that trained tutors, as a group, are no more effective 
in helping children improve their academic performance. 

The program in St. Louis was particularly unfruitful, with 38% 
attending no training meetings and an additional 16% attending less than 
half. From observation during a preservice site visit, it was generally not 
tutors involved ip Upswing's first year who missed the sessions. Thus, St. 
Louis offered a real comparison group made up predominately of tutors who 
had little if any formal training. As shown in Section IV, the St. Louis 
tutored group of children improved as much as the tutored group in any other 
city. 

CONCLUSIONS ABOUT THE EFFECTIVENESS OF TUTOR TRAINING 

The tutors' questionnaire responses, and their attendance at training 
meetings, were the criteria for evaluating the effectiveness of training in 
the second year of Upswing. Under these criteria, it must be said that the 
programs were no better than 50%-60% effective. This rating has nothing to 
do with the quality of training offered. Considerable time and effort were 
put into offering professional quality training responsive to the expressed 
needs of tutors. The training in the second year generally was markedly 
higher in quality than that offered in the first. 
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It appears that people value training more in theory than in practice 
and perhaps want it to be available even if they do not take advantage of it* 
Along these lines, it appears that training may have been considered more 
important in the first year because half of the tutors in the program were 
excluded from at tenting* It is clear that it does not pay to expend too much 
in training tutors, although some preparation is necessary* 

Tutors seem to have definite ideas about what training they want, and 
they focus clearly on techniques— what to do with the child. They seem to 
prefer that discussions of theory be minimal, and tied to observation of 
children. They generally want very much to know how instruction Is handled 
in the classroom and want to keep their efforts consonant. (There is a strong 
argument that ^'more of the same" in tutoring is not a good thing, especially 
when a child is having difficulty in class. However, the Upswing tutors and 
teachers most frequently seemed to support tutoring as a classroom back-up.) 
Such features as physical and social environment, training materials used, 
presentation format, and schedule seem to admit a good deal of latitude. 

There was a reduction in the rate of tutor attrition from the first 
year to the second year of Upswing. It appears that this is attributable to 
the combined effects of bringing preservice training closer to the start of 
tutoring, conducting more extensive inservlce training, and increasing the 
amount of r'^gular communication between tutors and project staff. The 
relative contributions of the training program and the communications 
structure outside training are considered in the conclusion of this section. 
Attrition is considered .separately in some detail in Section VI. 

In summary, it appears that the training of volunteers need not be 
elaborate or expensive. The content of training is less important than the 
fact of training. Thus, training should probably be geared to the voiced 
needs of the volunteers themselves, concentrating training on solving in- 
service problems. 

TRAINING/ORIENTATION FOR TEACHERS 

It was prescribed that all projects provide at least 10 hours of 
teacher training, covering, as a minimum, the following topics: 
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• Hcv to recognize minimal learning difficulties 

• Techniques and materials covered in tutor training 

• How to employ behavior modification (one of the 
training topics for volunteers). 

There was no stipulation about whether any of the teacher training 
should be provided during tutoring. All teachers were paid about $50 for 
lime spent on Upswing during the year. Table 33 shows the schedules for 
teacher orientation/training in the four cities. 

Preservlce 

Before tutoring began, the projects: 

• Defined the goals and organization of Upswing to 
teachers 

• Explained Upswing research aspects, with special 
emphasis on the reasons for establishing a control 
group (which was found in the first year to be a 
very difficult concept for many teachers to accept) 

• Explained what would be expected of teachers 
involved in the project: 

— Selection of children 

— Communication v;ith and encouragement of tutors, 
and guidance/assistance to the extent guidance 
was needed and the teacher had the time and 
interest 

— In two of the four projects, attCiilance at 
meetings throughout the year 

• Provided instruction/discussion/suggestions about 
how to observe children's behavior in a structured 
way and draw diagnostic conclusions about behavior 

• Reviewed use of the Cef;elka Academic Readiness 
Evalnfltion (CARE) as a screening aid in identifying 
learning difficulties in children. 

Three of the four projects also discussed with teachers the principles and 
te'^hniques of positive behavior management that tutors would be taught and 
encouraged to use. 
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PROJECT SCHEDULE FOR TEACHER ORIENTATION/TRAINING 





1972 


1973 


Total 


City 


Aug 


Sept 


Oct 


Nov 


Dec 


Jan 


Feb 


Mar 


Apr 


May 


, . — . 
























Pre 'Service: 
























Nc . of T.eptlngs 




2 


1 


1 














4 mtg 


No. of hours 




3 


1 


I 














5 hr 


Inservlce; 
























No. of meetings 
No. of hours 












1 
1 


1 
1 


1 

1 


1 
1 


Social get-together 
at each school 


4 mtg 
^hr 


Totals 






















8 mtg 
10 hi 


OXFORD 
























Pre service: 
























No. of meetings 


I 




















1 mtg 


No. of hours 


8 




















8 hr 


Inserv ice: 
























No . of meetings 




1 


1 
















2 mtg 


No. of hours 




1 


1 
















_2 hr 


Totals 






















3 mtg 
10 hr 


ST. LOUIS 
























Pre service: 
























cf .TCOtlngs 






1 
















I mtg 


No. of hours 






3 
















3 hr 


Inservlce: 




















?Jo. of meetings 
No. of hours 








No formal Inservlce training meetings; 1- 
Informal sociai/dlscusslcn gatherings at 
some schools 


2 




Totals 






















1 mtg 
3 hr 


SAN FRANCISCO 
























Preservlce 
























No. of "^et.'tlngs 




2 


















2 rntg 


• io. of hcurs 




5 


















5 hr 


Ins or/ Ice: 
























Nc . of rrf^ctl":ns 




1 


1 


1 






1 






1 


5 mtg 


**Q. of hours 




2^ 


- V 

• 2 


3 














11 hr 
























7 mtg 

18 hr 
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The initial interaction with teachers was done in one to four group 
meetings, with individual follow-up as needed in Denver, Oxford, and San 
Francisco. In St. Louis, staff visited each school to provide teachers 
individually with the information indicated above. A joint teacher-tutor 
meeting was held in St. Louis Just before the start of tutoring to get 
acquainted, discuss the characteristics of children with learning difficulties, 
demonstrate Peabody materials, and review the completed readiness inventories 
and their implications for instruction. 

Teacher Opinion About Preservice Training/Orientation 

Teachers also received a "Registration and First Impressions" ques- 
tionnaire (see Appendix B) that asked questions about the adequacy of the 
information they were given before tutoring began. Overall, their assess- 
ments were very favorable. The rates of response for this questionnaire 
were : 



City 


No . of Teachers 
in Project 


No . of Teachers 
Who Returned Form 


Response 
Rate 


Denver 


19 


16 


84% 


Oxford 


18 


18 


100% 


St. Louis 


15 


11 


73% 


San Francisco 


18 


15 


89% 



Table 34 indicates the degree of positive response to specific questions 
about substantive elements (as opposed to organizational elements) of the 
preparation Upswing teachers received. On the whole, the projects were quite 
successful in providing teachers wifh satisfactory information. There were 

"ir arai i self-perceived weaknesses in understanding of child selection 
parameters among teachers in Oxford and St. Louis. The pretest data indicate, 
however, that the Oxford and St. Louis teachers probably had as good a grasp 
on child selection parameters as the teachers in the other citit f. . The selec- 
cton criteria were not particularly specific in any project. 
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The other area where substantial comparative weaknesses appear Is 
knowledge of which children were assigned to the control group • That Is 
not an Important training assessment criterion, although the evaluation needed 
to know how many teachers had that Information, We would have preferred a 
blind or, better, double-blind experiment, but either would have required 
more testing than the project staffs or the sdiuuls could handle comfortably. 
Teachers In the first year were confused about the control group, and In a 
Rood number of cases, were disturbed because some pupils they referred did 
not get a tutor. Thus, It was decided to explain the use of controls explicitly 
and tell teachers which of their pupils were In that category, (The teachers 
should have known anyway If they remembered which of their pupils were tested 
for Upswing; apparently some did not remember,) 

Table 35 presents questions about the adequacy of organizational Infor- 
mation provided to teachers at the start of tutoring, with the percentages 
of positive response. In general, teachers were not as well Informed about 
organizational matters as about substantive; still, the overall picture is 
reasonably good. The responses In Table 35 represent a great Improvement over 
the first year. 

Inservice 

As noted previously, there was no requirement for the projects to 
offer an Inservice program for teachers participating In Upswing. The San 
Francisco and Denver projects did; the Oxford and St. Louis projects did 
not. There were two meetings for teachers In Oxford right after tutoring 
began, but these are not regarded as Inservice training since they covered 
mostly the same material as the preservlce meeting. In at least one St. 
Louis school there were two social gatherings of Upswing teachers for Informal 
discussion of the project; one took place at Christmas time and another during 
a visit by members of the evaluation staff. In all cities, the Upswing staff 
assigned to the schools as coordinators regularly checked with teachers to 
make sure there were no problems and to receive teachers' suggestions for 
the project. 

The focus of the teacher programs In Denver and San Francisco were 
sonewhat different. The Denver meetings (a one--hour session every month 
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except December) were explicitly to provide a workshop-type experience. The 
teachers were asked to state what topics they wanted to cover in these sessions 
and to share ideas about materials and instructional approaches they had found 
useful. The teachers were not particularly responsive to this request and 
the amount of interest they displayed at the sessions was disappointing to 
project staff. Teachers apparently found monthly meetings burdensome, and the 
stipend apparently did little to make them feel better about this demand. 

The San Francisco meetings were explicitly to inform teachers of the 
content of tutor training, to obtain teacher suggestions about what should be 
covered in tutor training and what the children needed in tutoring. In 
accomplishing its objectives for the teacher inservice program the San Fran- 
cisco project provided some training, or review of training had elsewhere. 
Teachers, like those in Denver, did not, as a group, show any gr-;at enthusiasm 
for the meetings. 

The San Francisco meetings, like those in Denver, were held after 
school. They were longer than the Denver meetings, generally 2-1/2 hours. 
Most took place toward the beginning of the project: four in September 
(three of those before tutoring began), one in October, and one in November. 
The teachers were brought together again in February and for a final session 
on the first of May. Such a schedule would not appear burdensome, except 
possibly in September. Still a significant proportion of the teachers 
indicated they felt there were too many Upswing meetings. 

Teachers ' Final Assessment of the Orientation/Training They Received 
From PrL.ect Upswing 

Teachers gave their retrospective opinions about Upswing orientation 
and training on a ''Final Impressions" questionnaire (copy in Appendix B) . The 
response rates were: 



City 


No. of Teachers 
in Project 


No. of Teachers 
Who Returned Form 


Response 
Rate 


Denver 


19 


IS 


100% 


Oxford 


18 


18 


100% 


St. Louis 


15 


11 


73% 


San Francisco 


18 


18 


100% 
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The data indicate, ovurall, that the projects were reasonably 
succe*^»sful in realizing the stated objectives for teacher training. It is 
perhaps most Interesting that the projects which held no formal meetings for 
teachers after tutoring began were rated about the same on most items as 
those which put comparativnly much greater effort into conducting a program 
for teachers. However, the data also indicate that teachers in the cities 
with more extensive programs may have gained more in certain respects from 
their participation. Further, there is strong evidence that the formal 
programs for teachers resulted in learning gains for children. 

Table 36 presents final questionnaire results that pertain to the 
substantive aspects of Upswing training. Ninety-two percent of all teachers 
valued the readiness inventory (the Cegelka Academic Readiness Evaluation, or 
CARE) they were trained to use as an aid in child selection. The small per- 
centage differences from city to city are not significant, since about 90% 
to 100% of teachers in all locations considered the inventory useful. (The 
CARE was not evaluated by teachers in relation to any of the many other existing 
readiness measures. We believe they were responding favorably to the concept 
of using some such inventory of learning beliaviors as an aid in identifying 
children's needs.) 

There was a somewhat broader range of response to the question on 
adequacy of information about tutors* techniques and materials. The Oxford 
program may have been comparatively weaker, although not deficient, in 
cescribing them to the satisfaction of teachers. However, the percentage 
difference between Oxford and St. Louis or Oxford and San Francisco Is not 
great enough to be very Important In view of the numbers of people Involved. 
The Denver program, which stressed Instructional approaches, appears to have 
been stronger In putting across tutors' methods and materials, but here as 
well, one should not make too much out" of 10% differences. The Important 
point Is that the projects apparently were successful In providing adequate 
Information on this point. 

Table 36 also shows that the teachers considered Upswing training 
moderately to very effective In helping them to work well with the tutors. 
The San Francisco project put special emphasis on clarifying the roles of 
tutor and teacher, with especially fine presentations on what each should 
expect from and give to the other. The Denver Inservlce meetings stressed 
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techniques for diagnosing and Instructing to children's needs, which emphasis 
nay have overridden the tutor-teacher relationship issue. Responses to the first 
questionnaire indicated that teachers there believed they had a clear view 
of their role and the tutor's at the start of the project (Table 34). 

The questions presented in Table 37 were asked to discover whether any 
dissatisfactions with teacher orientation/training were caused by logistics 
or environmental factors rather than content. The most important finding 
was about frequency of meetings. There were more teachers dissatisfied in. 
this respect in Denver and San Francisco, and all of them checked that they 
felt there should be fewer meetings (11 and 7 respondents, respectively). 
Two teachers in St. Louis thought there should be more meetings for teachers, 
while one in that city and one in Oxfolfc thought there should be none. (Two 
respondents in Oxford and one each in St. Louis and San Francisco skipped 
this question.) 

The teachers checked which, if any, of the last four items in Table 37 
caused them to miss Upswing meetings. Only 18% said they found any of those 
aspects so distasteful as to cause them not to attend. The most commonly 
troublesome was schedule; three respondents in Denver, four in San Francisco, 
and one in St. Louis said the schedule prevented them from attending one or 
more Upswing meetings. Two other teachers cited location. 

Table 37 shows that the Denver and San Francisco projects both were 
more successful in establishing a favorable group atmosphere, which would 
be expected si'nce they had more opportunities to develop it. (The question- 
naire item defined "social atmosphere" as "friendliness, opportunity to 
express your ideas, etc.".) However, neither social nor environmental con- 
ditions influenced de :isions to attend, according to the questionnaire 
responses . 

There was an interesting pattern of opinion about the importance of 
meetings for teachers in a project like Upswing. The fewer the meetings, 
the more important teachers thought they were (Figure 13). This trend apparently 
does not point to a trend of teachers wanting something they felt was lacking, 
since only two, in St. Louis, said they thought there shouLi have been more 
Upswing meetings. 
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Figure 14 shows a similar pattern of opinion about whether teachers in 
general would be witling to attend meetings for a project like Upswing if they 
were not paid. Those who had more meetings to attend, more often considered 
pay necessary. 

The foregoing evidence suggests that teachers tended to dislike having 
to commit time after school hours to Project Upswing. Nevertheless, there 
also were indications that the ''medicine** of Upswing training had some good 
effects. Teachers wore asked whether they thought participation in Upswing 
was beneficial to them professionally, and, if so, how. Table 38 shows their 
reasons. The differences in response pattern from city to city seem to reflect 
benefits of the inservice programs in San Francisco and, especially, Denver, 
where there was emphasis on offering teachers training per se. 

From Table 38 the Denver project was rated beneficial in more ways by 
more teachers than any other project. The San Franciscn project also clearly 
provided more teachers with new knowledge of instructional materials and tech- 
niques than the St. Louis or Oxford project. 

In site visits, we noted that the St. Louis schools offer comparatively 
little in the way of individualized instruction; thus whatever information 
Upswing offered in that regard would be more meaningful there than in the 
other cities, where the schools seemed to put a good bit of emphasis on individ- 
ualization. It should be noted that helping teachers themselves to individualize 
instruction was not a goal in any project; however, it was thought that increased 
awareness of the issue might result from involvement in a one-to-one tutoring 
program. 

The high Oxford response on use of helping personnel may have a reason 
similar to the reason suggested for St. Louis's high response on individualiza- 
tion. Oxford was the only Upswing location in which the schools had never before 
had a volunteer program. Working with volunt-p.prs was a totally new experience 
for most Oxford teachers. 

The most commonly valued aspect of Upswing participation was ''additional 
understanding about how to diagnose specific learning needs.** Observatioi^ 
indicated that this was stressed by all projects during the child selection 
period and that the use of the readiness inventory was important to teachers. 
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Do you think teachers generally would be willing to attend meetings as part 
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FIGURE 14. TEACHER OPINION ABOUT WHETHER TEACHERS 
GENERALLY WOULD BE WILLING TO ATTEND MEETINGS 
FOR A PROJECT LIKE UPSWING IF THEY WERE NOT PAID 
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Tf appeared that, alrhoiu^ji teacliers were familiar with the inventory concept 
and with many of the behaviors it included, many had not used such an instru- 
ment in structured observation of children. Anothci factor may have been that 
all projects made it a point to inform teachers of the results of the Upswing 
pretest battery (which was not done generally in the first year, to teachers^ 
dissatisfaction) * 

A ttendance at Upswing Orientation/Training 

Tables 39 and 40 summarize project records on teachers' attendance at 
Tpswing; meetings before and during tutoring.^ 

Attendance was better at preservice training than at inservice, and 
generally was better where there were fewer meetings. The data suggest that 
attendance had little to do with the content of meetings and seemingly much 
to do with their timing during the year, their frequency, and, probably, 
the nature of the city. Oxford offered the most preservice training — 8 hours 
(or 10 hours If one accepts the position that the tv/o follow-up hours after 
tutoring began were more in the spirit of preservice training) — and Oxford 
was the only city with 100% attendance, Denver fared a bit better on pre- 
service attendance than San Francisco, even though the former city held four 
sessions and the latter two for five hours of training. Table 39 shows roughly 
the same attendance rates for those two cities, but San Francisco had over 
three times as much inservice training as Denver. It could ba that the same 
rates would have prevailed if Denver had held as much inservice training as 
San Francisco. However, based on questionnaire data presented previously, 
Denver teachers appeared to feel somewhat more burdened by the training require 
ment, even though considerably fewer hours were involved. It appears likely 
that this happened because San Francisco put more hours in at the beginning 



• We have said that there was no inservice program for teachers in Oxford. 
"IVo one-hour meetings were held at each school very shortly after tutoring 
bep;an, and these are recorded in Table 33. However, because of the timing 
and content of these meetings, they were more in the nature of preservice 
training as previously discussed. 

155 



ERiC 



166 



BEST COPY AmmiE 



TABLE 39 

ATTENDANCE AT UPSV/ING PRESERVICE 
MEETINGS FOR TEACHERS 





Number of Teachers in Each Attendance Category 


Percentage of Training 
Teachers Attended 


Denver 
(five 1-hr 
meetings) 


Oxford 
(one 8-hr 
meeting) 


St. Louis 
(one 3-hr 
meeting) 


San Francisco 
(two 2t-hr 
meetings) 


90%-100% 


10 


18 


9 


12 


80% -8 9% 


6 




0 


0 


70%-79% 


0 




0 


0 


60% -6 9% 


1 




0 


0 


50%-59% 


0 




0 


0 


< 50% 


2 




0 


6 


0 


0 




3 


0 


Totr.l 


19 
100% 


18 
100% 


12 
100% 


18 

100% 
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TABLE 40 

ATTENDANCE AT UPSWING'S INSERVICE 
MEETINGS FOR TEACHERS 





Number of Teachers in Each 
Attendance Category 


Percentage of Training 
Teachers Attended 


Denver 
(four 1-hour 
meetings) 


Oxford 
(two 1-hour 
meetings) 


San Francisco 
(four 2| -hour 
meetings and 
one 3 -hour) 


90% -100% 


6 


18 


7 


80% -8 9% 


0 




0 


70%-79% 


6 




3 


60%-69% 


0 




0 


50%-59% 


3 




6 


< 50% 


3 




2 


0 


1 




0 


Total 


19 
100% 


18 

100% 


18 
100% 
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of the project and held longer meetings separated by greater time intervals. 
Another point about session length suggests itself: the teacher meetings 
were held right after school and teachers had to drive to them; if a teacher 
were delayed even a short time, there would not be much point in trying to 
get to a 1-hour meeting. 

CONCLUSIONS ABOUT THE EFFECTIVENESS OF TEACHER ORIENTATION/TRAINING 

The foregoing description of teacher orientation/training provides 
a framework for assessment of the projects^ effectiveness in that activity. 
Two criterion areas were established for the assessment: 

1. Effectiveness in training teachers to Identify 
children with minimal learning difficulties in 
accordance with the Upswing parameters for the 
child population 

2. Effectiveness In promoting good tutor-teacher 
working relationships. 

Criterion 1 

The measure of project effectiveness in training teachers to identify 
appropriate children was the initial characteristic of the children demon*- 
strated on the tests in the Upswing battery. As described previously, the 
tests covered reading, basic experiences, and self-esteem. It has been noted 
that, in addition, the readiness inventory data were to have been used in 
this assessment, but its use did not prove to be feasible. 

The test data indicate that teachers in all projects did select children 
in accordance with the basic Upswing parameters (potr.ntial for normal function- 
ing in school, with one or more minimal learning disorders expected to impact 
school functioning in the absence of "treatment" that a volunteer tutor could 
reasonably be expected to provide). The pretest results were as follows: 
• The children generally exhibited visual-motor 
integration skills at about the level expected 
at age five (exceptions: Denver and St. Louis control 
group children had a mean VMI age equivalent score 
of 5 years, 7 months). All but one of the Upswing 
children were over 6 years old, and about 60% were 
over 6-1/2 < (The control group children tonded to 
be younger than the tutored by a narrow margin.) 
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• The children tested quite low In basic experiences • 

Tho mean TORF. score for all children was In the 8th 
percentile. 

• Scores on the ''Funny Faces Oame" (self-esteem 
measure) were predominately in the borderline 
range betx>reen average and low. 

• Only about 25% of the children exhibited serious 
reading probleins on the pretest. About 35% 
scored in the low-average range and about 40% 
tested as average readers for their ages. 

Upswing was conceived as a project that focused on reading problems 
related to reading. Work on reading skills was to be the primary intent of 
tutoring. However, the selection criteria imply that just about any deficit 
qualified a child for Upswing tutoring, as long as it was not so severe as to 
require a specialist. As discussed in Section IV, it appears that the more 
visible difficulties were primary selection factors. 

We do not wish to place too much emphasis on reading skills. Cer- 
tainly reading problems are not the only justification for tutoring, but 
reading was set up as the primary criterion area for the evaluation of Upswing. 
Further, more significant gains were made In reading than in any of the other 
criterion areas which apparently were stronger selection factors. Thus there 
was some fuzzlness in the definition of project purposes and activities that 
is difficult to clear away. Reading was the focus of efforts to help children, 
although it was not necessarily their area of greatest need. This was true 
despite the fact that Upswing emphasized the Importance of looking at children 
as complete individuals and responding to learning need? of whatever kind as 
they arise. Perhaps child characteristics were believed to contribute to 
reading problems that in fact have no bearing on them; certainly, all of the 
variables measured in the Upswing evaluation proved to be orthogonal. 

In any case, teachers in all cities did successfully select children 
according to the project requirements. Thus, the training they were given 
in how to select children was effective* It is another series of debates 
whether tl\e selection criteria were overly peneralized, whether the stated 
goals of the prolect were operative, and whether the child selection criteria 
were appropriate for the project p,oals. The Upswing approach to child selection 
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reflects a view that nonspecific learning difficulties are relevant selection 
factors and, by extension, that one can help children to successful function- 
ing in school without determining what aspects of school achievement are 
impacted by their behavioral symptoms • 

The content of instruction on how to select children for the project 
was very similar from city to city and, as shown in the description of 
preservice training, the teachers perceived their understanding of selection 
parameters as good in all cities. (Roughly 80% to 100% said they had a 
clear understanding of how to choose children.) The format of presentation 
of this training apparently had little to do with its impact (I.e., whether 
teachers were informed individually, as in St. Louis, or in groups). 

Criterion 2 

The measure of training program effectiveness in promoting good 
tutor-teacher working relationships was the teacher assessment of the value 
of training in that regard, given in response to a questionnaire item. Over- 
all, 82% of the teachers said that the orientation or training they received 
was helpful to them in working well with the volunteer tutors. There were 
deferences from city to c'ty, with the lowest percentage of favorable 
responses from Denver teachers (63%) and the highest from San Francisco 
teachers (95%). The comparative ly low assessment in Denver may have been 
related to dissatisfaction with the greater frequency of teacher meetings 
they were asked to attend and with a concomitant tendency (again, com- 
paratively speaking) to consider teacher meetings less essential in a project 
like Upswing. (San Francisco teachers, however, tended to share in some 
negative feelings about the frequency and importanct: of meetings, although 
to a lesser extent.) Probably a more important reason for the difference 
in Denver was that teacher meetings there focused on how to work with 
children — identification of learning needs and appropriate instructional 
strategies. In San Francisco » on the other hand, role definitions and 
expectancies were expressed, and teachers' opinions about what the volunteer 
tutors should be doing were sought aci:ively. 
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The data indicate that, on the whole, teacher training resulted in 
improvements over the first vear in teacher satisfaction with the tutor-teacher 
relationship. (Tutors indicated satisfaction with the nature of the inter- 
action but often wanted ^voa? of it.) Tutors, overall, expressed need for nore 
guidance from teachers about as frequently in the second year as in the first, 

will be illustrated shortly. Denver teacher training had a different 
focus; probably for this reason teachers saw it as having comparatively less 
impact on tutor-teacher relationships. (Thirty percent of Denver tutors in- 
dicated they would have preferred more guidance from teachers. However, in 
Oxford, where teachers rated their training comparatively high on promoting 
Rood tutor-teacher relationships, about 50% of the tutors said they needed 
more guidance from their pupils' teachers — it is a matter of which side is 
perceiving. One intervening factor is that as the tutor-teacher relation- 
ship grov;s, the tutor may see the teacher's time as increasingly valuable 
to her. Thus, as the relationship quality increases, the satisfaction with 
available time could decrease. 

nFSCRIPTIOri OF PROJECT MANAGEMENT AND COMMUNICATIONS STRUCTURE IN 
THE SECOND YEAR OF UPSWING 

The project directors were free to set up any management and communi- 
cations structure they wanted, but all adopted es5>entially the same approach. 
Figure 15 is a p.eneralized management flow chart. 

There were variations to the structure illustrated in Figure 15, but 
these were more in detail than essentials. In Oxford there was no school 
volunteer organization other than Upswing, and the school liaison staff all 
were graduate students in the university's Department of Special Education. 
In Denver an Upswing volunteer from the first year, who continued to tutor, 
was one of the liaison staff along with two graduate students. In addition, 
there was a *'lead" volunteer tutor in at l«iast one school. In San Francisco, 
the assistant project director was a school system psychologist who devoted 
part of her time to Upswing. In addition, there was a very active, full-time 
project administrative assistant, who served also as a liaison person in the 
schools. Also in San Francisco, the preexisting school volunteer organization 
took a much more active roie than its counterparts in St. Louis and Denver. 
A representative of t\\i?. Snn Frnncisco organization participated in Upswing 
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Direct Reiponsibitity 



mmm Cooperatlon 

FIGURE 15. GENERAL MANAGEMENT STRUCTURE 
OF PROJECT UPSWING 
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planning and training meetings, called tutors about attending training 
meetings and to check on suggestions, problems, etc. In St. Louis, the 
assistant project director, as well as all other staff members, was a 
graduate student In the Department of Special Education. Responsibilities 
assumed varied with the personalities and expertise of the people involved, 
but despite such differences, the projects were more alike than dissimilar 
in management framework. 

There were three essential management tasks in running Project 
Upswing — (1) start-up activities including agreements with the school system 
and the Individual school administrators, defining needs for staff and the 
roles of individual members, hiring staff, the recruiting campaign, tutor 
and teacher orientation, organization and management of the child selection 
process and conduct of testing, etc.; (2) planning and conduct of ongoing 
training for tutors and teachers; and (3) supervision of tutoring activity 
in the schools. 

The project directors, with varying degrees of help from key staff 
members, took major responsibility for start-up tasks and the training 
activities. /\s the project developed, staff generally took more and more 
responsibility for planning and conducting training, but the directors 
maintained leadership of formal training activities. Staff soon functioned 
independently in their school liaison roles except if difficult problems 
arose. 

The essence of Upswing was the activity in the schools, and it appears 
that although some training is desirable to establish project identity and 
give tutors a feeling of competence, the training component can be a very 
small part of program activity. From a management point of view, a strong 
director seems essential at the beginning of the project, but this high- 
level person probably need spend relatively little time on it as staff in 
the schools take over routine activity. However, observation indicated that 
a readily ac^^esslble, informed central figure is necessary. The time demands 
on staff working In the school liaison function, however, remain fairly heavy 
throughout the tutoring period. 

Figure 16 shows the general nature of management and communications 
during tutoring. Again, there were differences, but the similarities were 
stronger. Each project assigned staff to visit each school regularly to 
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FIGURE 16 . GENERALIZED MODEL OF UPSWING MANAGEMENT AND 
COMMUNICATIONS IN THE SCHOOLS 
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assist tutors and check on attendance , to make sure project materials were In 
order, to resolve problems that might be of concern to teachers and principals, 
etc. The school liaison personnel were more deeply involved in some cities 
than others, but their basic function was the same everywhere — to be a re- 
sponsible project representative, readily available to keep things running 
smoothly. 

PARTICIPANTS' REACTIONS TO PROJECT COMMUNICATIONS IN THE SECOND YEAR 

Tutors and teachers were asked questions related to project communi- 
cations on their respective ''Final Impressions'' questionnaires. Their opinions 
about this aspect of Upswing are reported here, as well as general satisfac- 
tion with the project. Principals' reactions also were sought and are presented 
as the final elements of data for evaluation of Upswing training and manage- 
ment. 

Tutor Opinion About Communication 

Most of the tutors either said they were "satisfied" or "strongly 
satisfied" with the amount of communication they had with the Upswing staff, 
their tutee, the tutee's teacher, and other Upswing volunteers. San Francisco 
tutors who responded to the questionnaire seemed to be somewhat more satisfied 
in each of these categories than the respondents in the other three cities. 

Substantial proportions of Denver, Oxford, and St. Louis tutors did 
have some difficulty with teacher communication. Comments from these cities 
Indicated that tutors felt teachers did not provide enough feedback on the 
progress the children were Tiaklng. Thus, tutors were concerned that they might 
not be progressing with the children in the best direction. About 30% to 50% 
of tutors everywhere but San Francisco wanted more teacher guidance than they 
received. 

Figure 17 is a graphic representation of the mean satisfaction scores 
for each type of communication. 

Tutors indicated which channels were most important to the Upswing 
process. They indicated clearly ^hat communication with the child was most 
important; this was followed closely by communication with the teacher. Of 
lesser importance was communication with Upswing staff and of relatively 
little importance was communication with other tutors. '|.Tie channel most in 
need of improvement is between tutor and teacher. The r^iason is probably a 
lack of time for talk on both parts. The solution will not be simple. 
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By city, pupil communication was rated firs: also. But the second 
choice varied amonr, t\ut cltit^s. <>xt.ord respondents telt communication with 
UpswlnR staff was second in importance while respondents in the other three 
cities chose teacher communication. 

Tutors' Overall Satisfaction With Upswing 

About 90% of the tutors said they found their experience in Project 
Upswing satisfying or strongly satisfying. The split between the two degrees 
of satisfaction was virtually even for the project as a whole. There defi- 
nitely vas a greater degree of satisfaction expressed in Oxford, where almost 
60r said they were strongly satisfied, and the remainder responded "satisfied.** 
Only four tutors found the experience unsatisfactory (one out of 31 respondents 
to the questionnaire in Denver and three out of 15 respondents In San Francisco). 
Four others felt neutral about it (two in Denver and two in St. Louis.) Table 
41 gives the responses by city and project-wide. 

Cross-tabulated data indicated that satisfaction with communications of 
all kinds, satisfaction with the amount of guidance received from the teacher, 
and the tutor's perception of how much tutoring helped the child, were the most 
important determinants of overall satisfaction with the project. Comparison 
between neutral or dissatisfied tutors and those who expressed satisfaction Is 
not meaningful because there were so few in the first category. However, the 
just-mentioned variables clearly had an impact on whether a tutor was generally 
•'satisfied** or ''strongly satisfied." 

Teacher Opinion About Conmuni cations 

N'early all teachers were satisfied with the amount of interaction between 
them and Project Upswing staff (Table 42). As shown previously, teachers also 
generally considered their relationship with the volunteer tutors good, although 
there was less unanimity in this area. 

When asked to rank forms of tutor-teacher communication in order of 
desirability from the teacher point of view, teachers showed considerable 
diversity of opinion. However, more were Inclined to prefer Informal, one- 
to-one Interaction on an as-needed basis. There was some tendency for teachers 
to want to maintain control of this interaction (65% ranked teacher-initiated, 
infoXTTiai one-to-one meetings as first or second choice, while 53% ranked tutor- 
initiated meetings of this kind as first or second). The other favored option 
was :'eguiar tutor-teacher meetings, again one-to-one. Eighty-four percent 
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ranked this choice first, second, or third, but it was less favored than 
the as-ueoJed options as first or second choice. 

Teachers also were asked for an indication of their opinion about 
management and support of tutors in the schools by Upswing staff. Seventy- 
five percent considered the staffs' in^school activity the key reason for 
project effectiveness, while another 5% considered it useful but not essential. 
Fable A3 gives a complete breakdown of the responses. 

This question was asked to see whether teachers considered the school 
liaison role filled by someone outside the regular school staff as important 
as it was hypothesized to be. Principals were asked a similar question. The 
responses indicate that the liaison function as defined in Upswing was critical 
in the opinion of most school personnel involved. 

Teachers' Overall Satisfaction With Upswing 

3verall, teachers indicated about the same level of satisfaction 
from their involvement in the project as tutors. Eighty-nine percent either 
were "satisfied'* or "strongly satisfied," with about an even split between 
these two responses (Table 44) • San Francisco and Oxf )rd teachers expressed 
somewhat lower satisfaction than those in Denver and St. Louis, but these 
possible differences are difficult to interpret in view of the small numbers 
involved. Level of satisfaction with Upswing was not related to opinion 
about the effectiveness of tutoring in helping children. Only two teachers 
considered tutoring ineffective, and both of them said they were atr^ongly 
S'l^isficd with their experience in Project Upswing. The data from teachers 
did not indicate the primary contributors to high satisfaction as did the 
tutor data. 

Principals' Opinions About Project Upswing 

The principals of the 19 schools that participated in Upswing^ s second 
year also were sent a questionnaire at the end of the tutoring period (copy 
in Appendix B) . All 19 returned the form. The overall impression gained 
from the questionnaire responses was that the principals were enthusiastic 
about Project Upswing and were anxious to see it continue. One-to-one tutor- 
ing was seen as having ^'great potential** for helping children overcome learn- 
ing difficulties by 18 of the 19 respondents and as having ''moderate potential" 
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by one. The 18 assessed teacher attitudes toward the project as '^positive*' 
CO ''very positive." The major problem seemed to he space for tutoring. 

The questionnaire Included a check on whether Upswing training and 
management practices would give Upswing tutors preferred status. The 
principals' endorsement of volunteer tutors was not restricted to Upswing; 
however, all but one said they welcomed volunteer tutors in general* 
Reservations were expressed about high school student tutors and untrained 
tutors . 

:')-*r>r>i! XKd SuvorJ: s:07i . Almost all of the principals considered 
training essential for tutors, and Upswing training was assessed as high 
in quality. The inservice approach was endorsed. 

The Up:;wing staff's individualized support to tutors in the schoole 
was considered the key reason for project effectiveness by 16 of the 19 
respondents, and useful although not essential by two. One principal felt 
that the Upswing staff did not do a good Job, but someone other than regular 
school personnel is needed to perform this function. Six principals said 
they did not believe a program like Upswing could be run at all on an 
individual school basis, while 11 thought it could be done if funds were 
available for additional staff to conduct training and supervise tutors, as 
well as for materials. 

Trif^vo'^enents Frci the First to Second Year . All but one of the 
principals participated in Upswing both years, and 11 noted improvements 
in the second year. It was observed that the tutors seemed more confident, 
better prepared, more organized, more in*-erested and conscientious, and more 
dependable. These opinions were expressed by principals in all four cities. 
Principals from St. Lcils, San Francisco and Denver found an increase in 
the supervision by. the Upswing personnel working with the teachers and tutors. 
Principals in San Francisco, St. Louis, and Oxford reported increased en- 
thusiasm among teachers for the Upswing tutors and/or better rapport between 
tutors and teachers during the second year of the project. 

Principals registered the most unanimous enthusiasm for Upswing of 
any participant group. Coinments included at the end of the questionnaire 
touched upon the high caliber of the Upswing tutors, the rapport established 
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between rntors .ind tp.achers, and the enjoyment that the participating 
cliildren received fron t.lie addt d attention gLveii them. A quote from one 
of the St. Louis principals sums up the prevailing attitude: "[I have] 
nothing to add but positive thoughts and feelings about the Project.'' 

CONCLUSIONS ABOUT THE EFFECTIVENESS OF MANAGEMENT AND COMMUNICATIONS 
IN UPSWING 

Although there are anibiguities in assessing ^ny social system, 
general principles can be accurately evaluated. In the case of Upswing, 
a ;jlear pattern has developed. The project is perceived as desirable, 
effective, and useful, and these qualities are closely associated with the 
unique way In which the project was run. Great responsibility was delegated 
to the building- level coordinators. Much of the activity in Upswing was 
aliuovst autonomous, but run in cooperation and communication with the teachers 
and the svstem. The management system is so flexible that Upswing has 
been ^ible to adapt to each school *s unique needs and problems. Vast dif-* 
ferencen in attitude and environment found at schools within the same 
system are not >inusual. They do, however, present a problem to volunteer 
programs Which are centrally organized (as many are) . Close, continuous 
communication between Upswing personnel aad school personnel appear to have 
been essential to effective management. 

It is apparent that the person who is given responsibility for co- 
ordinating volunteers in each school should be sensitive to the political 
realities that affect teacher and principal attitudes. This sophistication 
appears to have been a very Important factor in keeping Upswing a minimal 
burden on the s'lhools. Because school personnel apparently were able to 
see Upswing as a small effort for large return, the attitudes of teachers 
and principals seem ?to have grown steadily more positive. 
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VI . THE PROBLEM OF ATTRITION 



Upswing, liVe all volunteer programs, haa the inherent problem of 
attrltiou. This section of the report uses the Upswing experience as a base 
for discussion of what level of attrition can be expected under various cir- 
cumstances, and presents some ideas on how to compensate for the problem. 

WHAT TO EXPECT 

The average Upswing Project can expect to lose 20%-40% of its 
original trained volunteers by the end of the school year. Attrition is 
Influenced by many environmental and personal factors, from moving to lack 
of motivation. These can be classified into two major areas: attrition 
that can be anticipated, compensated for, and to some extent controlled; 
and attrition beyond project control. The Upswing experience indicates 
that about 30^ of attrition will be in the former category and about 70% 
will be uncontrollable for an avera^;e program. 

f^ arly Losse s 

In the Upswing projects that depended on adult volunteers from the 
comuaitv* a large number of people who agreed to participate dropped out 
before tutoring began This was especially true in the first year, when 
there was a lengthy delay between orlentatlon/pre service training and the 
start of tutorlnp;. Kven without such a delay it would be wise to anticipate 
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that probably 25% to 50% .oi the people who show initial interest will not be- 
ein tiitortnp. Evidence suggests that about 10% of the people who begin train- 
ing can be expected to leave for reasons associated with dissatisfaction 
with training or the project management. Such problems as the training 
schedule, transportation, training too simple or advanced, poor instructions 
or guidance, etc., have been voiced by volunteers. An awareness of such 
attitudes on the part of the project manager can significantly improve 
retention of volunteers. 

A ttrition After Tutoring Begins 

Roughly 20% of beginning tutors can be expected to drop out of the 

4 

program completely some time during the school year. In addition to these 
true ''dropouts," a number of tutors appear to have dropped out for several 
short periods during the year, but returned to the pupil. Such activity 
was not reported until too late to document reasons. Accepting the premise 
that if a volunteer fails tc meet the child for more than one-half of the 
appointed times he is not an active volunteer, fully 50% of the original 
volunteers can be expected to be lost or go inactive by the school year's 
end. 

Much of the gradual attrition is attributable to moving and Job 
acquisition, or the ambiguous ''personal problems," These do not appear to 
be areas of loss over which the project manager can effectively exert control. 

Heavy use of college student tutors (perhaps younger students as 
well) changes the picture entirely and seems to make management of attrition 
much simpler. For example, Oxford, which used many students In the project 
had virtually full control of attrition. All of the people leaving the 
project did so according to schedule in December. The loss was expected, 
and plans were made to compensate for it. In this case attendance was 
controlled through the granting of college credit to students who faith- 
fully completed a full term of tutoring. The loss came at the end of the 
quarter when students left or changed schedule. 

PLANNING AHEAD 

It is clear tnat an effective Upswing project must foresee attrition 
and compensate for it. Each of the four cities in Upswing did this with 
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v.irvinv* .!oi;roL'S o\ siicrcss. *^ne of ihv najor prriblons ums that of preparing 

i'- r-.::;.-. i^- ».:;iti'r tiu- pi\)"uv:i 1 is I re.u:; (i V'^'^*'' 1 ^'^'^ tl\at was v ompoundud 
bt'caust* the evaluation needoil oonsistont treatment of tutors with regard 
to trainlutu at the citv level, for olarity of findinj'.s.) This was appruached 
in several ways. For example, videotape was used to record the original 
lessons. T!us ^ms not hl.^hly effectivtr because of the length of tapes (video- 
tape is vury expensive,* and difficult to edit) and the lack of a chance to 
respond. Sonetines the nonprofessional quality of the tapes was a further 
diMVv'b.iok. In one case the new recruit viewed tapes with the presence of an 
instructor '"ron the Upswing staff. This was a clear improvement, as it allowed 
interaction based on the taped material. 

!n other cases new volunteers were given a brief overview, with 
no .ittennt at full coverage of the preservice training. No evidence points 
to tlu* need for extensive tutor training. It appears tliat orientation with 
a ninimal amount of Inservlce training, preferably more toward the beginning 
of tutoring, would be effective. In fact, orientatlcm-only evidently Is 
sufficient if adequate supervision in the scliools is provided. Perhaps 
the ideal plan Is to have a continuous program of recruitment and orienta- 
tion so that Upswing can maintain a smooth continuity of service to the 
children. 
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VII. COST ANALYSIS 



This section very simply describes the basic expenses in Project 
Upswing's second year. The data do not provide a foundation for detailed 
analysis; further, pilot study costs under a fixed grant arrangement do not 
necessarily give a true picture of what the project might cost in another 
framework* In fact, since there appear to be only a few required features 
of Upswing, costs could vary greatly, depending on local circumstances and 
the preferences of those setting up the project. Even under the fixed grant, 
(each project had about $30,000), allocations of funds differed considerably 
from city to city. 

Ultimately, it must be left to the educational planner to weigh the 
benefits children derived from Upswing and decide if it is a competitive 
alternative for providing special help to children. This decision would be 
helped by comparison of the cost (as estimated for local conditions) and results 
of Upswing with the cost of remedial reading or with the cost of alternatives 
for boosting children's self-esteem or experience base (where such alternatives 
exist and their costs can be specified). An estimate like cost per unit of 
mean gain per child, as illustrated here, should suffice. It also should be 
noted that the characteristics of the project and therefore its budget should 
depend on what one wants it to accomplish. It appears that if benefits to 
tutored children are che sole concern, then a model such as that used in St. 
Louis during the second year would be appropriate, and it could cost consider- 
ably less than it did in the pilot project framework. However, if one is 
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Interested in the kind of generalized benefit observed In the other three 
.:Ities, it seems necessary to train teachers or provide some mechanism for 
strong teacher involvement. The project would then cost more, and it may 
be that Upswing is not the best way to modify the school environment so as 
to achieve the generalized effect. Other factors might also be considered 
in the decision to use or not use Upswing — as one example, the benefit to 
the school system, to society, or both, of increasing the number of oppor- 
tunities for community service. We cannot be exhaustive here, but these a.re 
some of the kinds of questions that would be in order in making a decision 
about whether to adopt a program like Upswing. 

METHODOLOGY AND DATA SOURCE FOR THE COST ANALYSIS 

Each of the four projects sent ORI a cost breakdown (see Appendix B) 
for a copy of cost report form). The breakdown Included estimates of per- 
centage of time spent on various activities required to run Upswing, the cost 
of materials, miscellaneous expenses Incurred during the year, etc. Tlie total 
cost Incurred for each activity was then distributed among the following: 

• Trained tutors who remained active 

• Trained tutors who dropped out 

• Teachers who remained active. 

Tutor costs were calculated on the basis of number who were Involved 
in the project at the time the costs were Incurred. Teacher costs were based 
on the total number of teachers trained, since very few left during the year. 

THE COST OF A TUTOR IN EACH PROJECT 

Table 45 presents the expenditures made in training and assisting one 
tutor in each project during the 1972-73 school year. Denver and Oxford spent 
approximately the same amount, while St. Louis and San Francisco spent more 
per tutor. The latter cities would have had lower costs if they had filled 
their goal quota of 50 voluntecirs per city, and if they had experienced less 
tutor attrition. In all cases, the greatest expenditures were for training 
and for supervision/assistance provided to tutors. 
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TABLE 45 



BEST COPY AVAILABLE 



COST OF ONE TUTOR WHO WAS IN PROJECT UPSWING 

FOR TJIE ENTIRE YEAR 



Cost 
Category 


Denver 
(40)* 


Oxford 
(47)* 


St. Louis 
(32)* 


San Francisco 
(32)* 


Recmiting 


$ 3x 


$ 19 


$ 60 


$ 55 


Preservlce 
training 


$ 59 


$ 19 


$ 51 


$ 64 


Inservice 
training 


$ 98 


$ 63 


$ 88 


$153 


Supervision 
<Sc assistance 


$ 74 


$ 60 


$ 92 


$166 


Running project 


$151 


$317 


$255 


$301 


Materials 


$ 24 


$ 13 


$ 22 


$ 26 


Other 


$ 10 




$ 8 


$ 1 


Total 


$447 


$491 


$576 


$766 



*Weighted average of the number of tutors during the 7-month span of the 
proj ect . 
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COST TO LOSE ONF TUTOR DURING THE YEAR 

Training tutors who end up not tutoring is an expensive proposition. 
The cost-effectiveness of an Upswing program is definitely impacted by 
attrition. Tutors left Project Upswing for various reasons throughout the 
year. Table A6 indicates the cost of losing one volunteer in each city* 
The cost of attrition was lower In Denver than St. Louis or San Francisco* 
Denver only lost five volunteers whereas the other two cities lost 18 and 
15 volunteers, respectively. The coat of attrition in Oxford was considerably 
lower than in arv of the other three cities because tutors there tended to be 
lost early in thi.*. project and training as well as supervision costs were 
spread evenly over the year. The other cities' losses were distributed 
through the year, and there tended to be heavier outlays at the beginning* 

Interpreting the meaning of lost volunteer costs can be difficult* 
Costs increase the longer the person remains in the program before leaving, 
but consider the services performed by the late dropout. A large number of 
early dropouts can be disastrous because they costi but give little or no 
service. Table 47 shows that Oxford's costs v;ere the lowest; they got about 
2-1/2 months service for $72, or about $37 a month per, person. Denver, on 
the other hand, averaged roughly 4 months service or about $90 a month per 
person. St. Louis paid more than $175, while San Francisco paid about $121 
per month for each dropout. Table 47 provides a quick comparison of the 
cost per month for both dropouts and "stay-ins." Attrition was quite ex- 
pensive, except in Oxford, which planned its attrition carefully and actually 
appears to ha-.-, profited from its dropouts. This appearance, however, is at 
least partly attributable to the universityVs bearing some of the cost of 
training, since Upswing constituted a university course. (For example, 
the meeting room was free.) The cost of recruitment was lower as well be- 
cause a large number of the tutors were obtained from among the students of 
the School of Education. Thus, public media did not have to be relied upon 
so heavily. 

COST TO TRAIN ONE TEACHER FOR PROJECT UPSWING 

As the city models have indicated, teacher training varied considerably. 
From Table 48, Oxford spent less to train and provide liaison with teachers 
compared to the other three cities* There were two reasons for this: 
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TABLE 46 



COST OF ONE TUTOR WHO DROPPED OUT OF 
PROJECT UPSWING DURING THE YEAR 



Cost 
Category 


Denver 
(5)* 


Oxford 
(12)* 


St. Louis 
(18)* 


San Francisco 
(15)* 


Recruiting & pre- 
service training 


$ 90 


$ 38 


$111 


$119 


Inservice 
training 


$ 98 


$ 8 


$ 89 


$120 


Supervision 
& assistance 


$ 58 


$ 8 


$ 69 


$130 


Running project 


$119 


$ 38 


$258 


$236 


Total 


$365 


$ 92 


$527 


$605 


*Number of tutors lost during the 1972-73 school year. 
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TABLE 48 



TEACHER COSTS IN PROJECT UPSWING BEST COPY AVAILABLE 



Cost 
Category 


Denver 
(19) 


Oxford 
(18) 


St. Louis 
(15) 


San Francisco 
(18) 


Preservice orien- 
tation, training, 
(staff, guest 

cnPaWprc; fscili— 

ties, etc.) 


$130 


$57 


$123 


$278 


Inservice training 


231 


31 


210 


124 


i^iciiovjii ov/Lxv iuy 

in schools 


127 


65 


131 


250 


Stipends 


55 


57 


67 


60 


Materials (office, 
supplies, reprints, 
film, videotape 
used in training, 
etc.) 


3 


13 


13 




Equipment 
(projector, coffee- 
making equipment, 
: etc.) 


4 








Overhead 




G 






Total 


$550 


$229 


$544 


$712 
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• There were only two public elementary schools in the 
Oxford project, which cut costs on staff interaction 
with teachers (the other cities averaged five to six 
schools) . 

t Less extensive training was given teachers in Oxford 
than in Denver or San Francisco. 
The highest teacher costs were in San Francisco. Preservice training and 
liaison activity were more expensive there because of the salary levels of 
personnel involved. The San Francisco project paid for the services of a 
university faculty member to help with preservice training. One of the staff 
members responsible for school liaison was a school system psychologist 
who served half time as assistant Upswing director. The other staff member 
responsible for school liaison was the full-time project administrative 
assistant. The other projects used graduate assistants earning half- or 
quarter-time stipends for the school liaison work. 

Teacher training costs in St. Louis are somewhat puzzling. They 
are roughly equivalent to the costs in Denver, where a great deal more work 
with teachers was done. The activity in St. Louis was much more like that 
in Oxford, with one preservice orientation meeting (8 hours in Oxford and 
3 hours in St. Louis) and no inservice activity except at the individual 
school level. It should be remembered that the cost data represent rough 
allocations of a fixed budget which vary in accuracy according to the time 
spent preparing the allocation and the precision of local recordkeeping. 

CnST TO UPGRADE CHILD PERFORMANCE ON WRAT 

PerLaps the most interesting way of looking at Upswing's cost is 
in terms of how much the gains cost. Table 49 gives a brief rundown of the 
wide range of cost from $33 to $89 per WRAT standard score point per child. 
The standard score increase indicates improvement beyond the expected level 
of performance. 

POTENTIAL FOR COST REDUCTION 

Since Project Upswing was designed to be flexible, one would expect 
costs to vary according to location and conditions. More important, one 
would expect costs per child served to vary according to the management 
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expertise, etc. The findings in this cost analysis, however, are distorted 
by the fixed funding level of each project. The artificial level of just 
over $30,000 caused great fluctuations in the per-child costs depending 
on the number of children served. Further, the findings are misleading 
because of the added cost of high-level administration personnel not re- 
quired (at least not full-time and probably not even half-time) after the 
program becomes operational. 

Evidence indicates that through the use of volunteer help to run 
portions of an Upswing program, use of token payments to training people 
and a single, carefully chosen paid administrator. Project Upswing could be 
run for less than $14 per child per month if 150 children were served. It 
would be possible for two or more small communities to cooperate on an Upswing 
program to save money. Considering that about 20% of the average class 
usually falls into the definition of an Upswing child, there would have to 
be about 750 first-graders in a community to require a full-time adminis- 
trator. Smaller communities could, by not using a full-time administrator, 
keep costs to a bare minimum. 
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VIII. CONCLUSIONS AND REC0^f1ENDATI0NS 
FROM THE UPSWING EVALUATION 



CONCLUSIONS 

This section has three parts* First, major conclusions from the two 
years of Upswing are reviewed* Then recommendations about the future of Up- 
swing are put forward. Finally, the experience suggests recommendations for 
further research — some that have to do with evaluation of Upswing-type programs 
and some that have to do with other issues that arose from the Upswing data. 
These recommendations are stated briefly in hopes that they may be useful to 
educational research planners and practitioners. 

Upswing iutoring was effectives ond the project 
seem to have given unexpected benefits beyond 
the good of tutoring. 

Upswing developed in such a way that it bad two results — one intended 
and one a byproduct. The two-year experience indicated that tutoring does 
help the children who receive it, and the tutors who give it, to an important 
degree. The experience also indicated that a project like Upswing, under cer- 
tain conditions, can extend its impact to teachers and through them to children 
who do not receive tutoring. The tutored groups of children in the first 
year made significantly greater gains in reading than did the untutored com- 
parison group. In the second year, tutored and untutored alike demonstrated 
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clear progress in reading and in development of self-esteem and basic 
experiences. 

The project goal was to help children realize their potential for 
normal functioning in the skill areas studied. The test results indicate 
this goal generally was accomplished in the areas of reading and self-esteem. 
Knd-of-year test means in both areas were in the average range, whereas at the 
beginning of the year the mean scores were in the low-average or borderline 
range. The children had farther to go in terms of basic experiences and did 
not pull up to average, but they did make significant progress in this area. 

The gains of control group children in the second year have been 
attributed to Upswing, with teachers as the agents. The project greatly 
strengthened its efforts to involve teachers in the second year, and it 
appears that teachers related differently to at least the Upswing control 
group children because of the influence of the project. It is impossible to 
say what portion of the teacher effect is attributable to Upswing training in 
itself. We would guess that little is, based on the findings about the effec- 
tiveness, as measured by child progress, of tutor training. However, it was 
intriguing (and rather shocking) to find that 60% of the teachers xrtio returned 
evaluation questionnaires said they had no training in child development other 
than that received in Upswing (all of which was provided in the second year). 

With regard to the amount of progress measured in the evaluation — it 
was modest, but indicative of significant growth. The test data behaved ''ell 
and appear to represent true effects. Other studies have reported more dramatic 
gains under tutoring, but we tend to be wary of accepting such findings. Enor- 
mous strides may well be made by some individual children; this happened in 
Upswing. On an aggregate basis , howe^^er, such large gains seem questionable. 

Sometimes amount of progress has to do with tutoring goals. If, for 
example, the goal is to help children overcome deficiency in recognizing vowel 
sounds, one can anticipate great success from a program of one-to-one drill 
over a few weeks. The subject matter of tutoring is quite limited; if the 
pre- and post-tutoring measurement device directly addresses the subject 
matter that was covered in tutoring, a high level of accuracy on the post- 
tutoring test would be quite reasonable except among children with certain 
types of learning problems. Upswing's goal for reading was much broader, and 
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a multitude of nonspecific deficiencies were being addressed. Further^ the 
measurement device was a standardized Instrument. Tutoring was not measure*- 
rererenced; rather, the attempt was to help children acquire skills that 
could be generalized. In these circumstances i the amoimt of mean progress 
demonstrated In Upswing seems both reasonable and quite heartening. We do 
not assume that volunteer tutors generally work miracles where the profits- 
slonals have failed , although with the right timing and a fortultoxis combin- 
ation of personalities I **mlracles** have been wrought In tutoring as well as 
In the classroom. 

Does Upswing tutoring work? The data Indicate that It does In the 
areas of reading^ self-esteem, and basic experiences. The only area studied 
In which tutoring did not appear to have appreciable Impact was vlsual^otor 
Integration; although there was a glimmer of Improvement In the second year. 
Beyond these basic questions, the evaluation yielded several most Interesting 
findings. These will be reviewed before recommendations for the project and 
for further study are made. 

The attributes etudied in Upswing developed 
independently of each other. None was a 
catalyst. Children experienced different 
amounts of success in different areas. 

The Upswing children tended, at the beginning of the year, to show 
low skills in all criterion areas. However, the initial associations are mis- 
leading 1^. that development in the various areas seems to go on independently. 
In other words, the criterion variables were orthogonal. Other researchers 
appear to disagree; they have found rather strong associations. The TOBE and 
the VMI documentation cite correlations on the order of 0.4 to 0.5 between those 
measures and reading measures. M r of about 0.3 was obtained between the TOBE 
and the introversion-extroversion scale of the Classroom Behavior Inventory 
(Earl S. Schaefer). The difference in findings probably is attributable to 
two conditions: 

1. The Upswing evaluation looked at amount of change 
while the test developers cited looked at actual 
scores at a given point in time. 




191 



201 



2. There were considerable differences in the 
operational definitions (measures) used. 
Knowledge of the amount of association in terms of change or development would 
seem to have more utility in helping children, but the necessary measurements 
are more time-consuming to obtain and more complicated in interpretation* 
Thus, the development approach often is not used. 

Probably most people in education and educational research believe that 
there is an association between school achievement level and self-esteem. The 
Upswing data do not belie this; they simply indicate that development of self- 
esteem can go on, or may not go on, regardless of a child's academic develop- 
ment* Individually, Upswing data are not conclusive, but the overall pattern 
is clear, that significant improvement in self-esteem will occur with personal 
attention from someone the child perceives as important in the given environ- 
ment (be it tutor, teacher, or another) and who believes in the child's capa- 
bilities and values his accomplishments whatever they may be. This improvement 
may be preceded by an improvement in skills. In sors» children it may be con- 
current with, or followed by, improved skills j in others, the skills appear 
unchanged within the short study period. 

Judging from the content of reading readiness inventories, it appears 
that visual-motor integration skills are commonly considered important in the 
development of reading skill. In the two years of Upswing, no support for that 
belief was found* 

It often has been put forth that "cultural deprivation" blocks develop- 
ment of reading skills. The Upswing evaluation tried to measure factors repre- 
sented by that term through the Test of Basic Experiences, which, given the 
age group, would have to come from home and kindergarten. Kindergarten exper- 
ience showed no relationship to initial TOBE results for the Upswing children, 
so it is assumed that the measure was of home-contributed basic experiences. 
Although the correlations between initial TOBE scores and initial scores from 
the other tests were significant, "treatment" appeared to override the influences 
of basic experiences or family background. The children made unexpected gains 
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on the TOBE itself. Moreover, progress in other areas shewed no meaningful 
relationship to initial TOBE score. 

It looks as if tutoring could be an effective 
substitute for remedial reading. Moreover^ 
it appears that the project presence may have 
made remedial reading work better. 

The above statements may seem extravagant / but the Upswing, data showed 
that tutored children averaged about as much gain in reading test standard score 
as children who had remedial reading. Moreover, children who had both a tutor 
and remedial reading averaged no more gain than those who had just one or the 
other. In fact, there was a suggestion that having both might be detrimental. 

The follcw-up on children tutored in the first year of Upswing added 
an interesting twist. These children had no involvement with the project during 
their second year in school except that they were tested at the end of the year. 
Of the follow-up group, 86 had special services and 80% of those had either 
remedial reading or a reading tutor (mostly the former). This group showed a 
slight decline in reading skill on the follow-mp test in relation to the test 
given at the end of their association with Upswing. Although these data are 
not conclusive, they strongly suggest that under ordinary circumstances, 
remedial reading may not be effective. It appears that being identified with 
a well-defined special project makes a difference in the kind of attention 
given children and the benefits they derive from it. Further, in view of 
the follow-up data, one must consider the possibility that it was not remedial 
reading that caused children in the second year of Upswing to gain but instead 
something in their relationship with tutors or teachers. 

Children generally held their ground in the 
year after Upswing; they did not continue to 
increase their rates of development in reading. 

The follow-up data show that the children tended to maintain their age- 
adjusted standard scores in reading during the year after Upswing. That io, 
they continued to acquire reading skills at the rate they had established by 
the end of the Upswing year. This was true of both former tutored and former 
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control group children. (There was a slight drop in the mean scores, but it 
was not incerpreble as a tendency to lose ground: average point loss on the 
reading test of about two points for tutored and half a point for control). 
The nature of attrition from the follow-up group, in conjunction with the 
general trend for children to hold their own in the year after tutoring » 
indicates that the benefits of Upswing tutoring may well be stable. 

Children who were retained in first grade 
retrogressed in reading during the follow^ 
up year. 

The decline in mean reading scores of the follow-up groups is mostly 
attributable to losses by children who were retained. The mean standard score 
of these children was in the average range at the end of Upswing. A year later, 
the group had fallen back into the low-average range. The mean loss was six 
points in standard score. (The initial standard deviation was small: 9,3 
points; the final standard deviation was even smaller: 7.4 points. This un- 
fortunately indicates the group was becoming more homogeneous in reading; i.e., 
the highest children dropped the most, to meet up with the lower ones.) Children 
placed in combination first and second grade classes averaged about one point 
lower standard scores. This amount of loss could be test error. Children who 
went on to second grade averaged about half a point gain, also not int -^rpreble. 

The decision to retain does not appear to have been based on reading 
level. However, retention had a definite negative effect on children's read- 
ing skills. We would judge that their reading losses are attributable to lower 
teacher expectancies, to insufficiently challenging reading material, and to 
the influence of the reading level of classmates. It seems reasonable to assume 
these children lost skills in other areas as well. If the trend should continue 
the children will lose status in the eyes of their peers, teachers, families, 
and> inevitably, in their own eyes, although they did not show lower self-esteem 
on the test or teacher assessment of self-confidence after one year. We do not 
know why these children were retained or if there was any objective foundation 
for the decision, but the evidence we have indicates that it was likely a bad 
decision. 
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The people invrlved in Upswing found it worth- 
while and wanted the project to continue^ 

Tutors, teachers, principals, and project staff made it clear in ques- 
tionnaire responses and conversation during site visits by the evaluation team 
that they consider Upswing both valuable to children and personally rewarding* 
Another Upswing was established with the help of the Denver project director 
in a coTimunity just outside the city during the second year of the evaluation* 
That project continues to operate. Tutors in the Denver project planned to 
contiinue Upswing on their own in several schools. The Denver project director 
is seeking foundation support in establishing a statewide tutoring program 
along the lines of Upswing and would eventually like to see it expanded to 
regional scale. 

A tutoring program has been established tentatively in Oxford as a 
result of Upswing. The Oxford project director indicated that there were no 
local funds for any additional school programs. The county school system 
has applied for a Title VII grant for a full-time coordinator of volunteer 
activities. They were successful in getting money to hire a person for this 
school year. 

The feeling in St. Louis was that to operate the project successfully, 
at least one full-time project director and two half-time assistants should be 
hired. The school system has not acted on this as far as we know. Neverthe- 
less, two St. Louis schools an* planning to continue the project on their own, 
and a third plans to follow suit. 

Upswing had strong support in San Francisco from the Departments of 
Curriculum and Pupil Personnel Services, the members of the school board and 
school discxTict administrators. The project director, assistant director and 
administrative assistant wrote a preliminary operational proposal and budget 
and presented it to the city. The San Francisco schools employ learning 
specialists to serve small clusters of schools. It was hoped that these people 
might take over Upswing coordination as part of their responsibilities. 

UPSWING'S FUTURE 

It appears at this writing that Upswing has a future; it should. This 
evaluation, after much deep searching has concluded that Upswing has value. 
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Compared to its expensive alternatives, it probabT^ is a good investment for 
most communities. Perhaps one of its most beneficial future uses will be in 
the less populous, less wealthy areas of the country, where children in need 
often do not receive professional help. Upswing offers them paraprofessional 
help that could be just as effective at a small fraction of the cost. 

Perhaps sprawling suburban school systems should reevaluate their 
vast expenditures for first- and second-grade reading remediation, A small 
portion of that budget might be well spent in establishing an Upswing type 
volunteer program. 

As we have see'u. Upswing can even work amid the complexities of a 
metropolitan school system. However, it requires reasonably sophisticated 
management to do so because of the communications and timing required. Despite 
this, the program is still probably far more cost-effective than anything 
presently available, 

RECOMMENDATIONS FOR FURTHER RESEARCH 

It should be stated at the outset that we believe the essential questions 
about tutoring on the Upswing model have been answered. It is not our intention 
here to suggest another Upswing evaluation on the scale of that just completed, 
although hopefully any replications will come up with some method of objectively 
checking on results with children. Some recommendations come to mind, however, 
thAt apply to the category in which the Upswing study falls — i,e,, evaluation 
of the effectiveness of an educational " treatment,'* 

A dovble-blind experiment would be the most 
profitable approach in evaluation of projects 
like Upswing. 

The Upswing evaluation would have provided more conclusive results if 
all first-grade children in the participating schools had been tested so that 
there could have been a tutored group and two matched comparison groups — one 
identified to teachers and one not identified. That would have permitted us 
to check on whether teacher effects were generalized or confined to the identified 
control children. It also would have been desirable to test children in com- 
parison schools not involved in Upswing (but similar in child population and 
resources to the Upswing schools) • Comparison of these results to the test 
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results obtained in Upswing schools would have permitted us to verify more 
clearly the project effect believed to have occurred. 

GeographtQ dispersal does not seen essential 
in a pilot study such as the Upswing evaluation. 

The Upswing evaluation could not use either of the foregoing more precise 
methods because of the cost and burden of testings which fell on the projects. 
However > we believe it would have been a profitable tradeoff to confine the 
project to one area and use the money saved to hire and train enough graduate 
student examiners to handle the required testing. If the evaluator were in 
close proximity to the project sites > the evaluator could assume responsibility 
for testing and test-scoring and therefore ensure greater consistency of ex- 
aminer training and administration procedures ^ as well as scoring accuracy. 
This approach would free project staff for the work of getting a project under 
way. 

In a pilot study such as Upswings in which there was never any pretense 
of sampling and extrapolating the results > there would seem to be no necessity, 
whatever to go to four different regions of the country. The four chosen are 
insufficient to represent the nation, even in a loose way, if that was the intent. 
There are undoubtedly many areas around the country where one could find large 
metropolitan inner-city, suburban, rural, and small city schools in reasonable 
proximity to each other. The Washington, D.C. area would have afforded such a 
mi;c ♦ 

The measures of ahild progi^ess that are used 
mst be selected very aare fully. 

This would seem to be an obvious stricture, but the Upswing evaluation 
ran into several problems because inappropriate measures yielded useless data. 
Although the Metropolitan series is widely used around the nation, the reading 
portions of the Primer and Primary I batteries definitely were not suitable for 
the Upswing evaluation; the test did the children an injustice. As an aside, we 
suspect it is not uncommon for school systems to put themselves in a bad light 
in periodic large-scale self-evaluations because of the tests used* 

In the first year of Upswing, no objective measure of self--esteem or 
self-concept was obtained because use of an inappropriate measure was prescribed. 
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The problems with interpreting the results of the Cegelka Academic Readiness 
Evaluation illustrate the Importance of scoring mechanisms designed for the 
analytical purpose for which the instrument is being used. 

Further reaearoh seem warranted by several 
of the secondary findings of the Upswing 
eva luation. 

It seems very important to explore the reasons underlying decisions 
to retain children in school and to follow children who have been retained at 
various grade levels to attempt to identify the effects of retention on them. 

The Upswing data also suggest that the education system could gain 
financially by an analysis of the cost-ef f ectivenesG of remedial reading 
versus tutoring or other alternatives at various grade levels. It also seems 
worthwhile to look into reasons underlying decision to place a child in a 
remedial reading program* 

The question of how children are evaluated in school involves both 
of the foregoing areas of inquiry. Stereotyping in student evaluation, and 
its impact, have been explored. Yet, we seem to be far from identifying the 
subjective criteria applied by teachers in deciding on their students* capa- 
bilities and needs. The Upswing data suggest that teachers tended to interpret 
one or two highly visible problems as indicative of more subtle problems whose 
effects would have generalized impact. The Upswing data did not provide 
evidence to support such an interpretation. 

Finally, it is clear that much more work needs to be done on identi- 
fication and objective measurement of the affective components of learning. 
The crude and mostly subjective measures now in use to explore such factors 
as self-esteem and motivation to achieve are far from adequate. In a broad 
sense, this gets into the question of what makes some people "good learners" 
(of what society considers it desirable to learn) and other people poor learners; 
also, what makes some people better tutors or teachers than others. There Is 
good evidence that the answers to these questions have more to do with affective 
characteristics of people and their relationships than with instructional tech- 
niques. 
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Mark Harris said In reviewing Rosenthal's research on the effects of 
expectancies^ that "teaching Is a form of loving ... teachers [and tutors] 
see what they expect to see^ and the pupil sees what the teacher sees," 
(Pdychotogy Today^ September 1973.) And the pupil does what he thinks he 
can do and what Is made worthwhile by the response of others. The effect 
of expectancy was evident In several aspects of the Upswing data. Moreover, 
It works on tutors and teachers as well as children. By reverberation, what 
the tutors and teachers feel about their ability to teach affects the children 
too* 

We are led to two conclusions* Firstt the training given anyone who 
is to work with children should emphasize how to look at children carefully; 
how to interpret thei:: academic and nonacademic behavior; how to expect good 
of them individually without applying too much pressure; the importance of 
being specific and sincere in recognizing children's successes— in short, 
training should emphasize the how-to of good learning relationships. Train-* 
ing also should help teachers to, (pardon the expression) a gut belief in 
the importance of relationships. Too many of us think we have faith, but 
when a child does not seem able to grasp the concept of long and short vowels 
we get desperate, defeated, or even hostile. As Bruno Bettelhelm says, 
''love is not enough''; we believe that Is true, but we believe love is essential. 

The second point we wish to make here has to do with the school environ*- 
nent. The long-established Hawthorne effect has shown that environmental 
changes like those brought about In Upswing can be perceived as a form of 
attention or recognition by teacher, child, and volunteer. Under such atten- 
tion there Is usually motivation to ^*look good." This results in positive 
activity and improved attitudes* For example, teachers apparently became more 
perceptive about the children with learning difficulties; they tended to give 
these children more positive attention. Shades of Rosenthal, positive attention 
seems to improve people ^s morale and make them work better; It is a way of 
saying you are import *nt — special effort for you Is worthwhile. In other 
words, envlronitental change is a stimulant. It appears that Project Upswing 
was In that category of phenomena. Teachers did not always like Upswing, but 
it brought them into contact with other people, other ideas* They interacted 
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on a personal basis with university staff. Involvement meant they were in a 
sense special. Tutors generally looked up to them; tutors and project staff 
alike valued their opinions and recognized the difficulty of the teacher's 
job. Involvement in Upswing may have stimulated competitive spirit in some 
teachers. We cannot pinpoint all of the possibilities of the situation. Yet, 
it seems clear that Upswing created a different kind of environment that was 
beneficial to teachers and to children as well. It seems like a good idea 
for school administrators to keep in mind the value in making school a special 
place, not just for children but for the adults there too. 
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0MB No. 51 -5730 1 8 
Expiration Date: 6/30/73 

VOLUNTEER FINAL IMPRESSIONS 

Name of Tutor: 

Child's Name: 

Teacher s Name: 

School: City: 

INFORMATION FOR PROJECT UPSWING USE ONLY 

The information requested on this form is to help evaluate Project Upswing and plan ways of using 
volunteers effectively in education programs. Please do not omit any answers. Individual names will not be 
used when the results arc printed. Space for comments is provided to give you the opportunity to express your 
individual ideas and feelings. Comments are optional. 

I . What is your general opinion about the Upswing group training meetings you attended this year? 
( Check one) 

a. I did not attend enough training meetings to have an opinion ( ) 

h. I did not need training ( J 

c. Training is not necessary for tutors ( ] 

d. Training generally was presented poorly ( ] 

e. It was useful but not essential ( ] 

f. It was very important to me in my work as a tutor [ J 

Comments: 




ROJECT UPSWING 



IfV'Hi checked a. b, or c in answering question /. skip to question 3. 

2. If you found the training sessions generally were useful, please indicate your major reasons. 
(Check the three most important) 

a. They gave me confidence 

b. They gave me knowledge of teaching techniques 

c. They helped me know what to expect from my pupil 

d. They helped me handle behavior problems 

e. They acquainted me with a variety of materials and their uses 

f. They helped me diagnose my pupil's specific learning needs 

g. They helped me tutor appropriately to meet my pupil's specific learning needs 
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h. They helped me to evaluate my pupiPs progress 

1. They helped mc U) have a better relationship with w.y pupil 

j. They helped me have a better relationship with my pupiPs teacher 

k. Other (piease specify) — — 

What is your general opinion about individual help you received from Project Upswing staff? 
(Check one) 

a. Individual help was not available to me 

b. I did not need individual help 

c. The Upswing staff generally did not give the kind of individual help I needed 

d. it was useful but not essential 

c. It was very important to me in my work as a tutor 

Comments: 



// vou checked a or h in answering question i. skip to question 5. 

4. If you found individual help generally was useful, please indicate your major reasons. 
(Check the three most important) 



a. It gave me confidence 

b. it gave me knowledge of teaching techniques 

c. it helped me know what to expect from my pupil 

d. it helped me handle behavior problems 

c. it acquainted me with a variety of materials and their uses 

r. it helped me diagnose my pupil's specific learning needs 

g. it helped me tutor appropriately to meet my pupil's specific learning needs 

h. it helped me to evaluate my pupil's progress 

i. it helped me to have a better relationship with my pUj il 

j. it helped me have a better relationship with my pupil's teacher 

k. Other (please specify) ^ 



5 



Which approach (group training or individual help) was most useful to you in tutoring? 
(Check one) 



a. Group 

b. Individual 

c. i found the two equally useful 

d. Neither was useful 
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(>. Please rate the volunteer training materials used by Project Upswing (for example, sample tutoring 
materials, handmits describing games and leaching techniques for use in tutoring, handouts about 
spcciliL icainmg problems). (Check i^nc} 

a. In general, the materials were inappropriate (useless for my needs, confusing, etc.) | | 

b. Some of the materials were helpfuL but on the whole they were of little value 

in niy opinion I I 

c. In general the materials were good I 1 

d. In general the materials were outstanding I 1 

e. There were very few or no training materials as far as 1 know | | 

7. Please list the tutoring materials that you found most valuable in working with your child. 
List no more than three. 



X. To what extent did you work on activities to build your pupiPs visual-motor integration skills 

(for example, cutting out pictures, tracing, handwriting, coloring, puzzles, manipulative games, etc.)? 
(Check and 

a. Rarely ornot at all I 1 

b. Sometimes ' I 1 

c. Frequently I 1 

Comments: 



Did you receive enough support from Project Upswing staff during the year? 

a. Yes I 1 

b. No I 1 

1 0. Could you have used other types of group training sessions? 

a. Yes I I 

b. No I 1 

If Yes, ''describe: 



1 1 . Could you have us<?d more individual counseling*^ 

a. Yes I 1 

b. No [ 1 

If **Yes." describe: , 
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1 2. Could you have used more tutoring materials? 

a. Yes I 1 

b. No I 1 

If "Yes;- describe: 



1 3. What other types of aid could you have used? 



14. Did you find the following aspects of Upswing meetings generally favorable (F) or generally 
unfavorable (U)? (Circle F or V for each item a-d) 

Favorable Unfavorable 

a. Schedule (day and time meetings 

were held) F U 

b. Location(s) of meetings F U 

c. Physical environment of meetings 
(for example temperature of room, 
amount of space, lighting, comfort 

of chairs, etc.) F U 

d. Social atmosphere of meetings (for 
example friendliness, opportunity to 

express your ideas, etc.) F U 

1 5. Did any of the aspects of Upswing meetings listed in question 1 4 cause you to miss one or 
more meetings? 

a. Yes I 

b. No I 

If **Yes/* please specify which caused you to miss meetings: 



B-6 

2i7 

ERIC 



lb. Please show vour satisfaction with coinnninications in Project Upswing by using the scale below. 

Strongly Strongly 
Dissatisfied Dissatisfied Satisned Satisfied 

SD D S SS 

Circle Satisfaction Rating 

a. Communications between you and Upswing staff SD D S SS 

b. Communications between you and your pupil SD D S SS 

c. Communications between you and your pupiPs 

teacher SD D S SS 

d. (Communications between you and other 

volunteer tutors SD D S SS 



Other (please specify) 



Comments; 



SD D S SS 



1 7. Which types of communication listed in question 16 do you think are most iniportant to being 
an effective tutor? (Check two) 

a b c d e. 

Comments: . 



I H. How do you feel about teacher guidance? (Check one) 

a- I would have preferred more guidance from my pupil's teacher ( 1 

b. The teacher has given me adequate guidance I I 

c. I would have preferred less guidance from the teacher 1 | 

d. I do not need any guidance from the teacher I I 

Ctmiments: 
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19. How do you feci about tht? overall effect of tutoring on your pupil'^ Please consider all types of 
possible effects - development ot academic skills, self-confidence, ability of child to control his 
behavior, motor coordination, etc. (Check one) 

a. I believe tutoring may have been bad for this child [ ] 

b. I do not know if tutoring has contriDu*ed to the child's development [ | 

c. I believe tutoring has made a small contribution to the child's development ( | 

d. I believe tutoring has made an important contribution to the child^s development [ | 

Co!^' nents: . . , . 



20. Please check the item that best describes how you feel about your experience with Project Upswing. 
(Check one) 

a. Strongly satisfied [ 

b. Satisfied ( 

c. Neutral (**take it or leave it") [ 

d. Dissatisfied [ 

e. Strongly dissatisfied [ 

Comments: ^ 



Thank you for your cooperation in filling out this questionnaire. Please also complete the attached 
*'St udent Profile," which has questions about the child you tutored. If you tutored more than one child in 
Upswing, complete a profile for each child. The space below is provided for any additional comiTicnts you 
may wish to make about Project Upswing and your role in it. • 
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STUDHNT PROFILE 



Child's Name: 

The following items pertain to the child you tutor. For each underlined topic, check ONE statement that 
generally applies to the child. 

1. Ease of conversation: 

a. Conversation with this child is not possible at this time ( 

b. Conversation with this child requires considerable effort on my part [ 

c. Child seems timid, but is able to engage in conversation ( 

d. Child IS able to hold conversation in a relaxed, spontaneous manner [ 

2. Initiation of conversation : 

a. So far. child rarely or never initiates conversation with me [ 

b. Child occasionally initiates conversation [ 

c. Child frequently initiates conversation I 

d. Child does not converse, but rather wants to talk constantly, cannot handle the 

"give and take'' of conversation I 

3. Speech characteristics: 

a. Child speaks at a reasonable level (volume) and can be understood | 

b. Child speaks at a very low level (volume), but can be heard and understood | 

c. Child speaks very softly, and/or "mumbles," is difficult to understand | 

d. Child speaks very loudly and aggressively 

4. Eye contact: 

a Child generally looks at the floor, ceiling, or elsewhere when we talk 

b. Child generally "looks me in the eye" when we talk 

c. Child stares at me in a blank or frightened way 

5. Approach to new tasks: 

a. Child generally seems interested and confident in undertaking a task he/she 

has never done before 

b. Child generally seems hesitant, but will try new tasks 

c. Child generally is unwilling to try a task he/she has never done before 
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(>. (.iciictal coiiridciico. 

a. This child appears ti) have little or no self-contldence ( | 

b. This child appears to be reasonably self-confident [ | 

c. Tins ciuld ap|vars to bo highly self-confidctit [ | 

The space below is provided for an> observations about the child that you feel might be of interest. 
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0MB No. 51-S73018 
Expiration Date: 6/30/73 



TEACHER FINAL IMPRESSIONS 



Name: . 
School: 



City: 



INFORMATION FOR PROJECT UPSWING USE ONLY 



The information requested on t!:c ^orm is to help evaluate Project Upswing and plan effective ways of 
using volunteers effectively in education programs. Please do not omit any answers. Individual names will not 
bo used when ihe lesults are tabulated. Space for comments is provided to give you the opportunity to express 
your individual ideas and feelings. Comments are optional. 

I . Projcci Upswing asked you to fill out a readiness inventory - the CARE - at the beginning of the school 
year for each child you referred as a tutoring candidate. You have been, or will be asked to fill out the 
CARF; for each one again at the end of the school year. Please check under "Yes" or "No" to answer the 
fi>llowine Questions about the inventory. 



a. The CARE is easy to fill out: 

b. The CARE is useful to teachers in identifying 
children with learning problems or potential 
learning problems: 

c. The CARE covers the appropriate behaviors 
foi first-grade children: 

d. The information from the CARE is useful to 
help volunteer tutors know what to expect 
from their pupils and what they need to work on: 

c. The CARE is useful in evaluating children's 
progress: 



Yes 



No 



Comments: 



Did you have enough information about the teaching approaches and materials used by the Upswing 
volunteer(s) who tutored your pupil(s)? (Check one) 



Yes 



b. No . 
Comments: . 



( I 
[ 1 
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.V In general, were the Upswing meetings for teachers useful in helping you and the vohmteer tutor(s) 
work well togethei'.* (Check onci 



a. They were a hindrance . . . 

b. They had ni^ effect 

c. Thev were somewhat useful 

d. They were very useful 

e. Did not attend 

Comments: 



Do you think teacher meetings arc important for a smoothly running volunteer tutoring program in 
ilic schools*.* (Check one) 



a. No 

b. They are helpfuL hut not essential 

c. They arc veiv nnpoiiani 

Comments: 



Were you satisfied with the frequency of Upswing teacher meetings? (Check one) 

a. Yes 

b. No. the mectmgs should have been held more often 

Nt). iherc were more meetings than were needed 

d. There were no meetings as far as I know 

{*omments: 



Were you satisfied with the amount of contact between you and Project Upswing staff other than 
in meetings? (Check ane) 

a. Yes 

b. No. 1 thought more informal contact was needed 

c- No. I thought Project staff contacted me more than necessary 

Comments: 
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7. Did you find the following aspects of Upswing meetings generally favorable (F)or generally unfavor- 



able (UT f Circle F or U for each item a - d) 

Favorable Unfavorable 

a. Schedule (day and time) of meetings F U 

b. Location! s) of meetings F U 

c. Physical environment of meetings (for 
example, temperature of room, amount of 

space, lighting, comfort of chairs, etc.) F U 

d. Si^cial atmosphere of meetings (for example, 
friendliness, opportunity to express your 

ideas, etc.) F U 

e. 1 here were no meetings as far as I know [ 

t. 1 did not go to the meetings [ 

g. 1 have no opinion [ 

.H. Did any of the aspects of Upswing meetings listed in question 7 cause you to miss one or more 
meetings? (Check one) 

a. Yes [ 

b. No [ 

If yes» please specify which caused you to miss meetings: 



t). Do y«^»! think teachers generally would be willing to attend meetings as part of their involvement in 
a project like Upswing if they could not be paid? (Check one) 

a. Yes 

h. No 

Comments: , 



10. Wliat is your opinion of the individual support given to Upswing volunteers by the project staff? 
(Check one) 

a. It is a key reason for Upswing's effectiveness 

b. It is useful but not essential 

c. It is not needed 

d. It is detrimental 

e. 1 believe individual support by someone other than school personnel is needed, but the 
support given by Project Upswing to its volunteers this year was not effective 

f. I don't know 

Comments: 
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Please rank the following kinds of volunteer-teacher communication. (Give the most desirable 
a J and the least desirable a 6. Use each ranking number, 1 through 6, only once.) 

a. Informal talks initiated by the teacher 

b. Informal talks initiated by the volunteer 

c. Regular meeting of teacher with all of her volunteers together 

d. Regular meeting of teacher and single volunteer 

e. Regular school-wide meetings of teacher and volunteers 

f. Regular city-wide meetings of Upswing teachers and volunteers 

Comments: 



In general do you believe that volunteer tutors are effective in working with first-grade children 
who have learning problems? (Check one) 

a. No [ 

b. Yes ( 

Comments: ^ 



13. Was your participation in Project Upswing beneficial to you as a professional educator? (Check one) 

a. No I 

b. Yes [ 

Comments: 



14. If your answer to Question 13 is "Yes," please indicate how Upswing was professionally helpful 
to you. (Check all that apply) 

a. Acquainted me with a greater variety of instructional materials 

b. Acquainted me with additional teaching techniques 

c. Gave me additional understanding about how to diagnose specific learning needs 

d. Gave me greater insight into how to individualize instruction for my pupils 

e. Incieased my ability to use helping personnel effectively 

f. Motivated me to further my education 

g Other (please specify) 

Comments: 
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15. Please check the item that best describes how you feel about your experience with Project Upswing. 
(Check one) 

a. Strongly satisfied [ 

b. Satisfied [ 

c. Neutral ("take it or leave it") ( 

d. Dissatisfied [ 

e. Strongly dissatisfied [ 

Comments: 



Thank you for your cooperation in filling out this questionnaire. Please be sure to complete the 
attached ''Student Profile" for each of the pupils in your class who received Upswing tutoring at least up 
to March 1 , 1973. Also complete a profile for each of your pupils who was in the Upswing control group. 
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INDIVIDUAL STUDENT PROFILE 



Child\sNamc: . Child's Sex: 

Teacher's Name: 

School: City: 

1 . Did this child attend kindergarten? (Check one) 

a. Yes [ 

b. No [ 

c. 1 don*l know [ 

2. Mow does this child communicate with his peers? (Check one) 

a. He/she docs not communicate with peers at all ( 

b. Communication is primarily nonverbal (i.e., play , hitting, signs, etc.) [ 

c. Communication is about equal amounts of verbal and nonverbal [ 

d. Communication is primarily verbal ( 

c. I don't know [ 

3. How often does he communicate with peers? (Check one) 

a. Frequently, more than most other children; initiate<i major'ly o{ the cornmi'nication .... [ 

b. Seems to be average in terms of communication with p :efs. initiate^ :*bru\ half of 
communications [ 

c. Below average: shows tendency to avoid communication [ 

d. I don't know [ 

4. Please show how readily this child forms relationships. Rank frr m 1 ^ 4. For example, 
if the child forms relationships most easily with adults, put 'M'' by "adults'! If Vii forms 
relationships next most easily with children his age, put "2'* b> :*)at answer choice. If 
he relates third most easily with older children, put ''3" by that answer choii^e and "4" 
by the remaining choice - ''Younger children." Assign each number only once. If you 
cannot rank all choices, put a check by ''Don't know." 

a. Adults [ 

b. Older children [ 

c. Children his own age [ 

d. Younger children [ 

e. I don't know I 
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5. Wow J.)os tills cliild appro.uh pl;i\ tnne'^ f Check <>nei 

A. Prefers lo play in large groups o( clnldrcn [ 

b. Prefers to play in small groups [ 

c. Prefers lo pl.iv b\ himself { 

d. I di)n'i kni)w [ 

6. How leadilv does ihis child participate in class discussions and activities? (Check onci 

a. Child t'retiiienily solunteers information, voliinieers for tasks, volunteers to answer 
t|uestions, etc [ 

b. Child sometimes volunteers, responds readily when called upon to participate [ 

c. Child nevci volunteers, seems shy when called upon to participate [ 

d. Child IS unable to participate in class discussions or activities (for example, seems 
confused, overwhelmed by embarrassment, frightened when called upon to participate, 

IS tot) easilv distracted, cannot carry out a task, etc.) [ 

7. How does this child relate to you? (Check tmel 

a. (*hild seeks attention from me almost constantly [ 

b. Child IS t'riendlv and responsive but able to function independently i' 

c. Child appears timid when relating to me [ 

d. Child appears hostile when relating to me [ 

F<ir cuch'\t the Iftlhwins underlmeJ topics, please check the statement that generally applies tn this child. 
H. Approach to new tasks: 

a. Child generally seems interested and confident in undertaking a task he/slie has never 

di>ne before [ 

b. Child generally appears hesitant or unwilling to try a task he/she has never 



t''ye ct>ntact during conversation: 

a. Child usually lot)ks me in the eye when we talk 

b. Child usually looks at the floor, ceilings or elsewhere when we talk . . 

10. Disputes with other child ren: 

a. Child generally avoids or withdraws from disputes with other children 
h. Child generally holds his/hci own in disputes with other children . . . 

c. Cliild frequently initiates conflict . seems to seek out conflict 



done before 
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1 1. General confidence: 

a. Child appears to have little or no self-confidence ( | 

b. Child appears to be reasonably self-confident ( | 

c. Child appears to be highly self-confident ( | 

The space below is provided for any observations about this child that you fee! might be of interest. 
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0MB No. 51 -5730 18 
Expiration Date: 6/30/73 



PRINCIPAL'S OPINIONS ABOUT UPSWING 



Principal's Name:. 
School: 



City: 



INFORMATION FOR PROJECT UPSWING USE ONLY 

The information requested on this form is to help evaluate Project Upswit:g and plan ways of using 
volunteers effectively in education programs. Please do not omit any answers. Individual names will not be 
used when the results are printed. Space for comments is provided to give you the opportunity to express your 
individual ideas and feelings. Comments are optional. 

1 . How long have you been associated with Project Upswing? (Check one) 

a. This school year only 

b. This and the last school year 

2. Did you have a clear understanding of the goals of Project Upswing? 

a. Yes. I believe so 

b. No 

Comments* ■ 



3.(a) Please indicate your overall opinion about having volunteer tutors in general working in your schoo 
(ChCik unci 

a. I welcome them 

b. Because of space problems I would prefer not to have them 

c. They cause a hardship to my staff that overbalances the good they do 

d They disrupt classrooms 

e. ! do not believe they arc effective in helping children overcome learning difficuhies 



Comments. 



3.(b) Please indicate your overall opinion about having Upswing volunteer tutors working in your school. 
(Check (me) 

a. I welcome them 

b. Because of space problems I would prefer not to have them 

c. They cause a hardship to my siaff that overbalances the good they do 

d. They disrupt classrooniS 

c. I do not believe they are effective in helping children overcome learning difficulties 



Comments 
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4.(a) What is your opinion about the need, in general , for training volunteer tutors? (Check one) 



A A N ^ple orientation and guidance from the teacher are sufficient [ 

b. Training is useful but not essential ( 

c. Training is essential for most volunteers [ 

Comments ^ ■ — — — — — 



4.(b) What IS your opinion about the need for training Upswing volunteer tutors? (Check one) 

a. A simple orientation and guidance from the teacher are sufficient [ 

b. Training is useful but not essential | 

c Training is essential for most volunteers [ 

Comments _ 



5. Wliat is your opinion about the individual support given to Project Upswing tutors by the project 
statn I Check one i 

a. It is a key reason for Upswing's effectiveness 

b. It IS useful but not essential 

c. It is not useful 

d. It IS detrimental 

e. I believe individual support by someone other than school personnel is needed, but the 
support given by Project Upswing to its volunteers this year was not effective 

f. 1 have no definite opinion 

Comments . 



6. How did most of the teachers on your staff seem to feel about Project Upswing? (Check one) 

a. Very negative 

b. Somewhat negative 

c. They seemed to have a **take it or leave it" attitude 

d. Positive 

e. Very positive 

Comments . ^ ^ • — 
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7. Please indicate your opinion about one-to-one tutoring (as given in Project Upswing) in the first 
grade as a way of helping children overcome learning difficulties. (Check one) 

a. I consider it an approach thai has great potential 

b. I consider it an approach that has moderate potential 

c. I am undecided about the value of this approach 

d. I consider it a low priority approach 

e. 1 consider it an ineffective approach 

Comments . 



8. Do you believe a tutoring program like Upswing could be operated successfully by an individual 



school** (Th.'Jt is, the school would recruit its own volunteer tutors and provide them with the 
necessary training, supervision, and materials.) (Check one) 

a. No [ 

b. Yes, if funds were available [ 

c. Yes, without any budget adjustment [ 

Comments 



^. To your knowledge, were other elementary school principals in the school system interested in 
having Upswing volunteers work in their schools? (Check one) 

a. Yes [ 

b. No [ 

c. Don't know [ 

Comments . - , 



10. Do you think the public school system would be willing to institute a tutoring program like Project 
Upswing as part of a volunteer program in the schools? (That is, the school system would recruit its 
own volunteer tutors and provide them with the necessary training, supervision, and materials.) 



(Check one) 

a. Yes, if funds were available ( 

b. Yes, without a budget adjustment ( 

c. No [ 

d. Don't know [ 

Comments 
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If you were associated wi»b Project Upswing both in its first and second years, what differences, if any, 
have you noticed about the project? (Check one) 

a. I have onlv been associated with Project Upswing this school y«Mr | 

b. I have not nunced any ditTcrcnces | 

0. I have noticed the following differences: 



Thank you for your cooperation in filHng out this questionnaire. The space below is provided 
for any additional comments you may wish to make about Project Upswing and your role in it. 
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PROJECT UPSWING ATTRITION REPORT 

(Check One) 

□ Teachtr □ Child □ Voluntwr 

Nam* _. ■■ 

School ^ 

City . ■ 

Datft Up$winfl Participation Endad (approximate) 



RaMon for Laaviny Program (if known) 



Report Ftllad Out by: 
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FROFECT UPSWING COST ANALYSIS FORM 



CITY NAME 

PURPOSE 

The purpose of this form is to gather information concerning how the 
Upswing budget dollars have been or are expected to be expended by the end 
of the school year. This cost Information will then be used In conjunction with 
measurement of the effectiveness of the results of the Upswing project. It is 
important that the dollar amounts provided are accurate; however, reasonable 
estimates will suffice when actual data are unavailable. 
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BEST corf AVWIABI£ 



A.l. PROJECT UPawIWG STAFF EXPENSES FOR THE lS(71-72 YEAR 



Sii:f 




Tlnio Spent on Ups.vlnq 


T.^t.il r>.ii.iry Rocolvod 
Tor VO'.ir Trom Up -ving 


Travel 


Ochor 


Ovjfhead Paid 
to University 


Total 


Numb^?r of Weo'^is | Hours p->r\Voek 
for Academic \Q'^^ ' Sponto:; Ups'Aln;j 


Prui *c: .!.r-?.:tor 














li( • l- r 












! 
1 










1 

! 

! 






















':!«:. • • 


■> — 



















1 
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.2. ESTIMATE OF PROJECT UPSWING STAFF COPY ^M]\ABll 

EXPENSES FOR THE 1972-73 YEAR 

BEST COPY AviiliABLE 



T":::::...:: j 


Expour.i?3 (dollars) 


Tlmo Spent on Upswing 




Travel 


Othor 


OvorhoAd Paid 
to University 


Totc\l 


Number of Woeks 
For Academic Year 


Hours por WoaJc 
Spent on Upswina 










..: • r 


1 


1 













'Hill 












• 




. . ;. - . :■! ^li 

















, ' < ; ' I".* . 








• * 








I 

1 . ..' IV" t 



























9 
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PERCENT Oi- TIME ALLOCATED TO VARIOUS PROJECT 
TASKS DURING THE 1971-72 YEAR AND AN 
ESTIMATE FOR THE 1972-73 YEAR 
(Total Time = 100%) 

BEST COPY AVAILABLE 



autla J 



Orientation of 
!/:.tr.^!iiod 7oUint'?.}r5 



71-72 



71-72 



/.N73 



Ms\:i.i'3cn:i!at .^nd 
Oporalloiis of 
Project 



71-72 



72-73 



Supervision and 
A3SlGtaaco to 
Volunteers 



Tramod 



71-72 



72-73 



Untrained 



71-72 



72-73 



Othor 



Trained 



VI -7^ 



Untrained 



71-72 



Total 
(100%) 



7?-73 



■ v. } :i Ul'"'* itl^iM {.<r jr vUx it-i \:*. ;l it ^nt, -.t Ulri'; 0.\*r V.tM rvjfnV'r cf i'i«Ml'^ a-i';lr{Mnt<j In ijMcn provided. 
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BEST COPY 



AVAILABLE 



c. 



Training Program Costs 
(other than staff salaries) 

Materials used in training 
(books , film, etc.) 

Room used in training 

Other expenses incurred 
for training (specify) 



Total 



Estimates of Year Costs 


1971-72 


1972-73 


$ 

V 


$ 

V 


$ 

V 


$ 


$ 


$ 


$ 


$ 


$ 


$ 


$ 


$ 


$ 


$ 
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BEST COPV A'lW^^ 





Estimate of Year Costs 


Miscellaneous Expenses 


1971-72 


1972-73 


Expenditures for volunteer 
recruitment not otherwise 
listed (e.o.. soot announce- 
ments, flyers, printing, etc.) 


$ 


$ 


Cost of instructional 
materials used by tutors 
(DISTAR, Peabody, Kits, 
etc.) 


$ 


$ 


it •• ill* 
Other costs incurred that 

are not included in the 

questions above (please 

itemize) 






Item 








$ 


$ 




$ 


$ 




<t 

V 


<t 

V 




$ 


$ 


Total 


$ 


$ 
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BEGT COPY AVAILABLE 

Adequacy of Funds (answer for only the 1971-72 year) 

1 . Do you feel that sufficient funds were 
available for project staffing? 

Yes No 

Please explain. 



2. Do you feel that sufficient funds were 
available for materials? 

Yes No 

Explain. 



3 . Do you feel sufficient funds were 
available to conduct training? 

Yes No 

Explain. 
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BEST COPY AVAILABLE 



Do you feel there were items for which actual 
costs incurred were significantly higher or 
lower than had been anticipated in the original 
budget? 

Yes No 
Explain. 



Did the Upswing project overrun its costs ? 
Yes No 
Explain. 



a. What was the amount of the additional funds received? 
$ 

b. What were these funds used for? 

Suggestions and recommendations for future budgeting. 
{Please make any suggestions or comments relating to 
budgeting which you feel might be beneficial to other 
Upswing Directors.) 
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BEST COPY flVAIl.riBlE 

F, Total Student Load 

What is the total number of students that could be 
supported in the 71-72 and 72-73 models of Upswing 
within the budget allowances for those years ? 



Year 


Present Number 


Maximum 


71- 72 

72- 73 
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